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'\N  Abstract 

y 

The  Pilot’s  Associate  (PA)  Program  has  been  initiated  to  help  mitigate  the 
extensive  workload  of  the  fighter  pilot.  To  operate  effectively,  the  PA  system  must 
have  situation  awareness:  the  status  of  important  on-board  and  off-board  systems. 
This  knowledge  is  gained  through  sensor  svstems.  The  data  from  these  systems 

r  9- 

must  be  fused  together  to  present  the  PA  with  a  coherent  picture  ot  the  internal 
(on-board)  and  external  (off-board)  states.  Although  many  types  of  information  can 
be  extracted  from  sensor  data,  this  paper  emphasizes  those  parameters  that  help 
determine  target  track.  One  common  technique  for  fusing  sensor  data  uses  Kalman 
filters.  In  a  multiple  model  adaptive  filter  (MMAF)  system,  the  most  appropriate 
Kalman  filter  is  chosen.  This  filter  provides  the  "best  estimates  of  the  desired 
states. 

An  operating  MMAF  system  continually  selects  which  filter  to  use  as  the  basis 
for  the  state  estimates.  The  overall  accuracy  of  the  system  is  closely  related  to  how 
well  the  filters  are  selected.  Previous  filter  selection  techniques  have  proved  useful, 
but  limited.  To  overcome  some  of  these  limitations,  an  expert  system.  KREST, 
was  developed  so  that  expert  rules  could  be  used  to  select  filters.  Although  no 
quantitative  estimate  of  improvement  is  available,  the  MMAF  expert  stated  that 
KREST  exhibited  a  potentially  significant  improvement  over  the  previously  used 
filter  selection  techniques.  .  •  ,-i  y  -  ./  •>'  / 
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I.  Thesis  Introduction. 


1.1  Overview. 

The  Pilot’s  Associate  (PA)  Program  has  been  initiated  to  help  mitigate  the 
extensive  workload  of  the  fighter  pilot.  Its  purpose  is  to  have  a  computerized  "co¬ 
pilot”  relieve  the  pilot  of  time-consuming  tasks  so  he  can  concentrate  on  targets, 
threats,  and  terrain.  Key  to  this  system  is  an  appreciation  of  situation  awareness: 
the  status  of  important  on-board  and  off-board  systems.  This  knowledge  is  gained 
through  sensor  systems.  The  data  from  these  systems  must  be  “fused”  together  to 
present  the  PA  with  a  coherent  picture  of  the  internal  (on-board)  and  external  (off- 
board)  states.  Although  many  types  of  information  can  be  extracted  from  sensor 
data,  this  paper  will  emphasize  those  parameters  that  help  determine  target  track. 
One  common  technique  for  fusing  sensor  data  uses  Kalman  filters.  In  a  multiple 
model  adaptive  filter  (MMAF)  system,  the  most  appropriate  Kalman  filter  is  chosen 
to  provide  the  “best”  estimates  of  the  desired  states. 

1.2  Thesis  Statement. 

An  expert  system  can  be  developed,  using  expert  knowledge  of  Kalman  filter 
characteristics,  to  select  the  “best”  estimates  of  the  desired  state  information  from 
a  sensor  fusion  system  using  such  filters. 


1,3  Introduction  of  PA  program  and  need  for  sensor  fusion. 

I  he  workload  of  the  fighter  pilot  has  been  steadily  increasing.  Today's  pilot 
is  expected  to  keep  track  of  a  myriad  of  systems  and  sub-systems,  checking  them 
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for  anomalies,  while  simultaneously  engaging  a  target  and  possibly  evading  a  hostile 
threat.  “The  number  of  tasks  he  needs  to  perform  far  exceeds  the  number  humanly 
possible”  [18,  p.  1] .  This  workload  will  continue  to  increase  as  the  next  generation  of 
fighter  aircraft  introduce  new  sensors  to  which  the  pilot  must  respond. 

The  information  content  of  the  sensor  “subsystems”  is  steadily  increas¬ 
ing  through  innovations  such  as  active-element  phased-array  radar  an¬ 
tennas,  focal-plane  array  infrared  sensors,  on-board  digital  terrain  and 
feature  storage  systems,  high-sensitivity  with  high-angular  accuracy  anti¬ 
radiation  sensors,  improved  navigation  sensors  and  integrated  communi¬ 
cations  systems  [5,  p.1330]. 

The  problem  of  information  overload  can  occur  when  an  individual  receives 
more  data  than  he  or  she  can  assimilate.  When  the  fighter  pilot  experiences  this 
problem,  he  may  begin  to  subconsciously  filter  out  internal  or  external  state  infor¬ 
mation.  Internal  state  information  includes  the  status  of  his  aircraft  and  weapons. 
External  state  information  includes  the  location  of  threats,  targets,  and  terrain  fea¬ 
tures.  By  ignoring  portions  of  the  data  being  presented  to  him,  the  pilot  can  concen¬ 
trate  on  his  prime  objective.  Unfortunately,  some  of  the  information  not  reaching 
the  pilot  may  be  crucial  to  the  accomplishment  of  his  objective.  It  may  even  be 
crucial  to  his  survival. 

Before  we  proceed,  two  relevant  terms  need  to  be  defined:  artificial  intelligence 
(AI)  and  expert  system.  The  definition  of  AI  is  nebulous.  For  this  paper,  the 
working  definition  shall  be  “those  attributes  which  provide  a  computer  system  with 
the  capability  to  solve  problems  which  are  currently  better  solved  by  humans."  The 
term  “expert  system”  is  defined  as  “. . .  a  computer  program  that  simulates  a  human 
expert  in  a  certain  field  of  knowledge”  [20,  p.l]. 

To  alleviate  the  workload  of  future  fighter  pilots,  the  Defense  Advanced  Re¬ 
search  Projects  Agency  (DARPA)  has  created  the  Pilot's  Associate  (PA)  Program. 
The  specific  purpose  of  this  program  is  to  demonstrate  and  evaluate  the  use  ul  AI 
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and  expert  systems  for  increasing  the  effectiveness  of  future  combat  aircraft  [5,  p.3]. 
A  more  thorough  definition  of  PA  is  provided  by  Robert  G.  Eisenhardt: 

Primary  functions  of  the  Pilot’s  Associate  are  to  generate  information 
from  available  data  sources,  make  assessments  and  draw  conclusions  in 
time  domains  inaccessible  to  the  pilot,  initiate  direct  action  where  hu¬ 
man  response  time  is  limiting,  and  provide  the  pilot/crew  with  selected 
data/information  in  a  manner  that  incorporates  the  pilot  in  the  system 
in  the  most  efficient  manner.  Its  objective  is  to  ensure  that,  from  the 
system  as  a  whole,  the  most  tactically  effective  decision  will  always  be 
made  during  combat.  [4,  p.54] 

The  kernel  task  of  the  PA  system  is  the  retrieval  of  available  sensor  data  and 
the  development  of  assessments  based  upon  that  data.  Without  this  “real  world” 
information,  the  system  can  neither  suggest  nor  initiate  logical  actions.  For  exam¬ 
ple,  consider  a  ground-attack  mission  in  progress.  The  pilot  basis  all  his  actions 
upon  his  perception  of  internal  (e.g.,  fuel  level  and  weapon  load)  and  external  (e.g., 
threat  aircraft  locations  and  weather  conditions)  state  information.  By  organizing 
and  examining  this  data,  a  system  (human  or  computer)  can  develop  an  informed 
response. 

A  significant  problem  with  perceiving  the  external  state  is  the  uncertainty 
associated  with  the  sensed  data.  Certain  sensors  are  designed  to  provide  various 
types  of  information  about  potential  threats.  Types  of  information  desired  in  a  next 
generation  tracking/identification  system  include  [23.  p.1452]: 

1.  Track  Number. 

2.  Number  of  frames  coasted. 

3.  Frequency. 

4.  Pulse  Repetition  Interval. 

5.  Angle  of  Arrival. 

6.  Elevation. 

7.  Range  Rate. 

8.  Lethality  (low  to  high). 
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9.  State  Vector  (X,  X,  Y,  Y,  Z,  Z). 

10.  Time  to  last  measurement. 

11.  Target  ID  (e.g.,  MiG-21). 

12.  Range. 

13.  Threat  Weapon  Suite. 

14.  Current  Time.  Current  Time. 


Each  sensor  system  has  its  own  strengths  and  weaknesses  and  thus  supplies 
data  with  varying  degrees  of  precision  and  accuracy.  For  instance,  a  laser  rangefinder 
may  provide  excellent  range  data  and  relatively  poor  elevation  and  azimuth  data. 
Relative  accuracies  of  selected  fighter  aircraft  sensors  are  given  in  Table  1.  By 
combining  data  from  these  various  sources,  using  some  type  of  sensor  fusion  (SF) 
process,  complementary  and  competing  interpretations  can  be  combined  to  deter¬ 
mine  the  most  likely  external  state.  This  fusion  process  must  take  into  consideration 
the  associated  uncertainties  in  order  to  intelligently  combine  the  data. 


Table  1.  Relative  Sensor  Accuracies. 


Sensor 

Parameter 

Relative 

Accuracy 

Radar 

Range 

Good 

Range  Rate 

Good 

Azimuth 

Fair 

Elevation 

Poor 

ESM 

Azimuth 

Poor 

Target  ID 

Good 

PRI,  RF 

Good 

IR 

Azimuth 

Good 

Elevation 

Good 

Threat  Warning 

Missile  Approach  Warning 

Good 

IFF 

Friend,  Foe.  Neutral 

Good 

Range 

Good 

Height 

Good 

Source:  [23.  p.l  1">2] 
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There  are  actually  two  types  of  uncertainty  that  the  PA  will  need  to  consider. 
First  is  the  uncertainty  associated  with  the  data.  This  includes  both  accuracy  and 
precision.  This  is  the  type  of  uncertainty  that  will  be  addressed  in  this  paper.  The 
second  uncertainty  deals  with  the  logic  used  to  combine  the  sensed  information. 
For  instance,  assume  the  radar  has  identified  a  target  with  a  certain  amount  of 
accuracy  and  precision.  Also  assume  the  infrared  search  track  (IRST)  system  has 
also  identified  a  target  at  a  position  close  to  that  identified  by  the  radar.  The  system 
may  choose  to  assume  these  “targets”  are  actually  a  single  target  or  that  there  are 
really  two  targets  flying  in  proximity  to  one  another.  The  system  should  provide  the 
confidence  level  or  measure  of  certainty  associated  with  this  conclusion. 

The  data  from  the  individual  sensors  tend  to  be  very  noisy.  One  technique  that 
has  been  used  extensively  in  “cleaning  up”  the  data  involves  Kalman  filters.  (See 
Section  3.1  for  more  information  on  Kalman  filters.)  In  this  application,  a  Kalman 
filter  may  be  thought  of  as  a  black  box  whose  input  is  the  data  from  one  or  more 
sensors  and  whose  output  is  one  or  more  desired  parameters.  For  instance,  the  input 
may  be  the  sensed  X-direction  position  while  the  output  is  the  velocity  in  that  same 
direction.  The  filter  uses  feedback  and  weighting  functions  to  determine  the  "best" 
estimate  by  comparing  the  previous  estimate  with  newly  sensed  data.  For  example, 
consider  the  case  where  the  X-direction  position  datum  was  2000.00  kin  and  the 
resulting  X-direction  velocity  estimate  is  3G0  km/hr.  If  a  new  datum  is  taken  every 
second,  the  next  value  should  be  2000.10.  If  the  actual  datum  is  2000.08  then  the 
velocity  estimate  needs  to  be  changed  and/or  the  datum  is  incorrect.  The  weighting 
functions  can  be  tuned  to  emphasize  the  actual  data  or  the  estimate  of  what  that 
data  “should”  have  been.  If  the  actual  data  is  emphasized  too  much,  the  output  will 
become  noisy  just  like  the  input.  However,  if  the  estimate  of  the  data  is  emphasized 
too  much,  the  system  will  not  respond  quickly  enough  to  changes  being  indicated  by 
the  sensors. 
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^  Sensor  data  fusion  can  take  place  at  two  points  within  the  SF  portion  of  the 

PA.  The  fusion  can  occur  after  the  data  from  the  sensors  have  been  ‘‘cleaned  up"’ 
by  the  Kalman  filters,  or  it  can  occur  within  the  set  of  filters.  Research  is  being 
conducted  in  both  of  these  areas.  Much  of  the  current  work  within  the  AI  community 
^  in  the  field  of  reasoning  under  uncertainty  (RUU)  has  attempted  to  merge  the  data 

after  the  filtering  process  since  the  Kalman  filters  algorithmically  smooth  the  data. 
Hence,  the  RUU  programs  can  use  data  with  much  less  inherent  noise.  Some  of  the 
t  previous  research  in  this  field  will  be  addressed  in  Chapter  2.  Work  being  conducted 

by  Kalman  filter  experts  has  emphasized  fusion  within  the  filtering  process.  This 
includes  developing  advanced  filter  models  and  improved  filter  selection  techniques. 

’  1.4  Expert  System  Justification 

Donald  Waterman  has  outlined  several  criteria  that  lie  believes  a  project  must 
meet  in  order  to  show  that  an  expert  system  is  necessary  [22,  p.  129].  These  items 
1  are  listed  below. 

•  The  task  must  not  require  common  sense.  The  Kalman  filter  expert  system 
does  not. 

» 

•  The  task  must  require  cognitive  and  not  physical  skills.  Xo  physical  skills  were 
required  in  this  problem  domain. 

^  •  Genuine  experts  must  exist.  A  Kalman  fillet  .expert  was  selected:  Dr.  Peter 

May  beck  of  the  Air  Force  Institute  of  Technology,  Wright-Pattersou  AFB.  Oil. 
In  addition  to  having  several  published  papers  :n  this  field.  Dr.  May  beck  has 
written  several  books  on  the  subject  [  1 0]  [llj. 


•  Experts  must  agree  on  the  solutions.  Since  only  one  expert  was  used,  this 
was  not  a  problem.  \  numeric  evaluation  of  the  expert  system  results  would 
indicate  how  well  the  expert  did  at  selecting  Kalman  filters,  however  it  was 
decided  that  a  numeric  evaluation  would  be  beyond  the  scope  of  this  research. 
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•  The  expert  must  be  able  to  articulate  his  reasoning  methods.  The  expert  was 
confident  that  he  could  select  filters  better  than  the  original  system,  but  it 
was  not  clear  what  the  basis  for  this  selection  would  be.  Much  of  this  research 
centered  on  identifying  the  information  needed  by  the  expert  to  make  the 
decisions. 

•  The  task  must  not  be  too  difficult  nor  poorly  understood.  The  final  goal, 
selecting  a  filter,  was  easily  understood,  however  the  actual  selection  process 
was  not.  By  presenting  the  expert  with  information  he  felt  was  necessary,  both 
the  expert  and  the  knowledge  engineer  gained  a  better  understanding  of  the 
filter  selection  process. 

Donald  Waterman  also  identified  criteria  to  justify  the  development  of  an  ex¬ 
pert  system  [22,  p.  130].  Several  apply  in  this  case: 

•  Is  human  expertise  scarce?  While  the  overall  operation  of  multiple  Kalman 
filter  systems  is  well  understood,  the  limitations  associated  with  filter  models 
is  not  as  generally  understood. 

•  Is  the  expertise  needed  at  many  locations?  Yes,  since  this  type  of  system  would 
eventually  be  executing  in  real-time  on-board  a  fighter  aircraft.. 

•  Is  the  expertise  needed  in  a  hostile  environment?  Yes,  for  the  reason  listed 
above. 


1.5  Scope  of  Research 

The  purpose  of  this  research  was  to  investigate  the  use  of  an  A I  technique  to 
help  improve  the  sensor  fusion  capability  within  the  Kalman  filter  system.  Specif¬ 
ically,  this  required  that  an  expert  system  be  developed  using  expert  knowledge  of 
Kalman  filter  characteristics,  to  select  the  "best"  estimates  ot  desired  parameters. 

Some  type  of  simulated  multiple  model  Kalman  filter  program  was  needed  to 
develop  the  expert  system.  Ideally,  this  program  should  have  simulated  the  fusion  ol 
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data  from  fighter  aircraft  avionics.  Since  this  type  of  Kalman  filter  software  was  not 
available,  we  chose  to  build  an  expert  system  to  evaluate  the  filter  selection  process  of 
an  existing  Kalman  filter  program  which  simulated  five  discrete  filters.  These  filters 
did  not  simulate  sensor  fusion.  However,  according  to  the  expert  [14],  improvements 
resulting  from  the  use  of  the  expert  system  should  be  extendable  to  filters  combining 
and  contrasting  data  from  multiple  sensors.  This  results  because  the  expert  system 
does  not  reason  over  the  input  to  the  Kalman  filters  (i.e.,  data  from  one  or  more 
sensors),  but  on  the  output  from  the  filters  (i.e.,  the  state  estimates,  residual  values, 
etc.).  An  expert  system  could  be  designed  to  be  oblivious  to  which  sensor  or  set 
of  sensors  provides  data  for  each  filter.  However,  this  type  of  information  may  be 
useful  in  enhancing  system  performance. 

After  identifying  the  Kalman  filter  simulation  program  to  be  used,  three  major 
tasks  remained,  constituting  the  bulk  of  the  research.  These  tasks  were:  to  determine 
from  a  Kalman  filter  expert  what  ba.us  he  uses  for  selecting  the  best  filter,  to  acquire 
and  encode  this  knowledge  in  an  expert  system,  and  to  compare  the  performance  of 
that  expert  system  with  the  current  filter  selection  process. 


II.  Historical  Development 
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Before  delving  into  historical  approaches  to  reasoning  under  uncertainty  and 
Kalman  filter  developments,  an  appreciation  for  the  mission  of  the  Pilot’s  Associate 
will  be  given.  By  reviewing  the  various  modules  of  the  PA  and  how  they  interrelate, 
the  reader  can  gain  an  appreciation  for  the  types  of  information  required  from  the 
SF  portion  of  the  system.  Following  this  discussion,  some  of  the  past  and  present 
techniques  of  reasoning  under  uncertainty  and  Kalman  filter  usage  will  be  presented. 

2.1  Mission  and  background  of  the  J-’A  system. 

The  concept  of  the  Pilot’s  Associate  needs  to  be  partitioned  in  order  to  keep  it 
manageable.  There  have  been  several  attempts  at  identifying  the  major  components 
of  the  PA  system.  Kenneth  Maxwell  and  James  Davis  have  identified  three  major 
components:  the  Pilot/ AI  Interface,  the  AI  System,  and  the  Al/Vehicle  Interface 
[15,  p.9l|.  They  further  divide  the  AI  System  into  Knowledge  Bases  and  Control 
Structures  [15,  p.9 1].  Dr.  Teichgraeber  also  identifies  three  components:  Situation 
Awareness,  Tactics  Planning,  and  Internal  Systems  Monitoring  [20,  p.  1  ] .  A  more 
elaborate  division  of  PA  components  is  provided  by  Major  Frankovich  and  Messrs. 
Pedersen  and  Bcrnsteen.  They  identify  three  possible  divisions  of  avionics  tasks  as 
part  of  the  PA  system.  Their  minimum  configuration  has  four  components:  Flight 
Systems,  Offensive  Systems,  Defensive  Systems,  and  Status  and  Configuration  [5. 
p.  1332] .  While  there  may  be  merits  to  each  of  these  partitionings,  a  clearer  division 
is  provided  by  Robert  F.iseuhardt.  lie  identifies  the  following  five  major  components: 
Pilot/Vehicle  Interface.  Mission  Manager.  Tactical  Manager.  Situation  Awareness 
Manager,  and  System  Status  Manager  [l.  p. '><>].  In  this  organization,  the  SA  Manager 
is  responsible  for  controlling  the  sensor  systems  and  fusing  the  sensei  I  data.  I  hose 
respoiisibilit  ies  are  in  addition  to  that  of  assigning  state  vectors  (e.g..  position  and 
velocity)  and  providing  target  classification  information  about  each  threat  I.  p  "7\ 
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The  functional  diagram  developed  by  the  AFWAL  Pilot’s  Associate  Program  is 
very  similar  to  that  identified  by  Mr.  Eiscnhardt,  except  that  the  PA  Program  version 
provides  a  separate  manager  for  controlling  and  integrating  the  sensor  resources. 
This  manager  will  be  referred  to  as  the  Sensor  Fusion  (SF)  Manager.  Although  the 
SF  Manager  is  not  strictly  part  of  the  PA  system,  its  function  is  key  to  that  system’s 
mission.  As  with  any  computer  program,  the  performance  of  the  PA  system  can 
only  be  as  good  as  the  data  being  entered  in.  This  partioning,  shown  in  Figure  1, 
will  be  referenced  throughout  the  remainder  of  this  paper. 


Figure  1.  Pilot's  Associate  Block  Diagram 
[l.p.y] 

2.1.1  Pilot/\  chicle  Interface.  1  lie  Pilot / \ 'chicle  Interlace  ( 1  ’ \  ||  will  have  a 
significant  impact  on  how  the  whole  PA  system  is  accepted  by  pilots.  In  the  past, 
new  weapon/sensor  systems  have  required  a  pilot  to  keep  track  ol  more  data  while  he 
■dim  i  It  uucous  I  v  at  tempt  s  to  engage  a  pit  mat  y  1  argot .  A*  the  pilot  becomes  -..it  ui  at  >  d 
with  in  lor  mat  ion,  he  unconsciously  igtiotes  celt  ain  pot  t  ions  ol  that  in  lor  mat  ion.  1  he 


PVI  must  present  information  to  the  pilot  in  a  quantity  and  mode  that  will  allow 
him  to  evaluate  the  situation  and  select  appropriate  responses  in  a  minimal  amount 
of  time,  without  becoming  saturated  [15,  p.90]. 

The  quantity  attribute  of  presented  information  is  related  to  the  concept  of 
Miller’s  Magic  Number  Seven  [8].  This  limit  refers  to  the  number  of  simultaneous 
tasks  which  an  individual  can  keep  track.  As  the  pilot  becomes  busy  (such  as  when 
attacking  a  target),  the  PVI  should  restrain  from  overwhelming  him  with  data.  As 
the  pilot’s  workload  becomes  lighter,  more  data  can  be  presented  to  him  without 
overwhelming  his  capabilities.  The  mode  attribute  of  the  PVI  is  another  area  of 
investigation  [15,  p.9l].  Several  modes  are  available,  including  cathode  ray  tube, 
heads-up  display,  control  panel  lights,  buzzers,  synthetic  voice,  etc.  Human  factors 
engineers,  using  techniques  developed  in  cognitive  psychology,  will  need  to  identify 
the  most  effective  means  of  conveying  information  to  the  pilot. 

2.1.2  Mission  Manager.  The  Mission  Manager  component  of  the  PA  is  re¬ 
sponsible  for  the  navigation  and  route  planning  functions.  This  component  must 
identify  a  flight  corridor  which  considers 

. . .  tactical  doctrine,  aircraft  capability  and  loadout  (fuel,  weapons,  avion¬ 
ics),  mission  objective,  terrain,  known  ground  threat  locations,  probable 
threat  areas,  probable  air  threat,  time  windows  coordinating  the  mission, 
and  target  and  alternative  target  locations  [5,  p.  1 332] . 

This  manager  is  also  responsible  for  responding  to  changes  in  the  mission.  If 
the  pilot  is  redirected  to  an  alternate  target  or  if  he  must  discontinue  his  mission 
due  to  malfunction/damage,  the  Mission  Manager  must  provide  the  pilot  with  his 
new  options  [1,  p .  1  —  ] . 

2.1.2  Tactical  Manager  The  Tactical  Manager  is  responsible  for  combat  en¬ 
gagement  options  and  weapon  selection.  This  function  shall  ..recommend  to  the 


termeasures)  to  deal  with  the  current  combat  situation”  [1,  p.  1 1] .  These  tasks  are 
fairly  well  understood  and  have  been  researched,  in  part,  by  Captain  Sobota.  Her 
thesis  identified  the  process  used  by  F-16C  aircraft  in  the  air-to-ground  weapons  de¬ 
livery  mode  [18,  p.9].  The  main  thrust  of  her  research  was  to  develop  a  mechanism 
whereby  a  pilot  could  “tell”  the  computer  the  desired  sequence  for  weapon  selection. 
This  would  allow  the  PA  to  know  not  only  the  proper  sequence  (which  can  often  be 
varied),  but  also  the  sequence  that  the  pilot  preferred.  A  complete  Tactical  Man¬ 
ager  would  also  include  engagement  options.  This  system  would  provide  options  to 
ignore,  evade,  or  attack  a  target,  and,  if  necessary,  a  preference  in  how  the  target  is 
to  be  engaged  [1,  p.  10]. 

2.1. 4  System  Status  Manager.  The  System  Status  (SS)  Manager  is  responsi¬ 
ble  for  monitoring  all  on-board  systems  so  as  to  identify,  diagnose,  and  verify  systems 
that  are  malfunctioning  [1,  p.llj.  More  specifically,  the  “. . .  SS  function  shall  monitor 
the  status  of  on-board  expendable  resources  (e.g..  fuel,  weapons,  etc.)  and  external, 
cooperative  resources  (e.g.,  wingmen,  AWACS,  C3I  functions)”  [1.  p.ll].  If  impor¬ 
tant.  this  information  may  be  sent  to  other  PA  Managers.  Information  regarding 
emergency  situations  would  be  sent  to  the  Mission  and  Tactical  Managers  as  well 
as  directly  to  the  pilot  through  the  pilot/vehicle  interface.  The  SS  will  also  pro¬ 
vide  a  suggested  course  of  action  to  the  pilot  to  help  minimize  the  severity  of  the 
malfunction  [l,  p.l  1], 

2.1.5  Situation  Assessment  Manager.  This  manager  is  responsible  for  deter¬ 
mining  the  threat  potential  and  intent  assessment  of  enemy  weapons  and  for  assessing 
the  external  environment  conditions  [1,  p .  1 0] .  In  other  words,  the  Situation  Assess¬ 
ment  (SA)  Manager  must  ". .  .  provide  the  pilot  and  other  major  processors  with  as 
complete  and  current  a  description  (model)  of  the  current  external  world  as  possible" 


ager  to  the  Mission  and  Tactical  Managers.  Thus,  mission  and  tactical  planning 
can  be  performed  in  response  to  the  changing  threat.  If  a  situation  arises  requir¬ 
ing  the  notification  of  the  pilot,  the  necessary  information  is  sent  directly  to  the 
PVI  for  display  [4,  p.56].  If  the  notification  requires  an  immediate  response,  the 
Tactical  Manager  should  be  able  to  provide  (and,  in  emergency  situations,  possibly 
automatically  execute)  a  suggested  course  of  action. 

2.1.6  Sensor  Fusion  Manager.  The  plethora  of  raw  data  might  overwhelm 
the  SA  Manager.  In  order  to  extract  higher  level  information  from  this  data,  a 
Sensor  Fusion  Manager  [23,  p.  1451]  has  been  suggested.  Data  entering  this  module 
would  be  sourced  from  the  identify  friend/foe  system  (IFF),  radar,  infrared  search 
track  (IRST),  electronic  support  measures  (ESM),  inertial  navigation  system  (INS), 
and  communication  links  [4,  p.58].  This  module  fuses  the  measurements  from  these 
sources  “. . .  to  formulate  a  ‘single  picture’  of  the  surveillance  volume  'seen'  periodi¬ 
cally”  [23,  p.1451].  This  fused  data  may  be  presented  to  the  pilot,  used  to  update 
fire  control  data,  and/or  sent  to  the  SA  Manager.  The  Sensor  Fusion  Manager  also 
uses  this  data,  primarily  for  sensor  allocation  and  management  [4,  p.57]. 

The  performance  of  the  other  managers  is  dependent,  at  least  in  part,  on  the 
SF  Manager.  Thus,  any  improvements  in  the  performance  of  the  SF  Manager  should 
result  in  improved  overall  performance  of  the  PA  system.  Because  of  this,  the  SF 
Manager  was  selected  as  the  basis  for  research  in  this  paper.  The  remainder  of 
Chapter  2  will  address  previous  efforts  to  improve  the  sensor  fusion  process. 


2.2  Previous  sensor  fusion  research. 

One  of  the  primary  reasons  for  having  sensors  on-board  tactical  aircraft  is  to 
provide  the  pilot  with  an  improved  sense  of  situational  awareness.  This  awareness 
falls  into  several  categories.  These  categories  include:  navigation  ("Where  am  17”). 
system  status  (“Is  everything  okay?"),  target  detection  ("Is  anyone  out  there?"). 
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target  tracking  (“Where  are  they?”),  target  identification  (“Who  are  they?”),  and 
threat  assessment  (“Who’s  my  biggest  threat?”).  To  get  this  information,  sensor 
data  must  be  fused  and  interpreted. 

The  problem  of  sensor  fusion  stems  from  the  fact  that  there  is  no  ideal  sensor 
providing  totally  accurate  and  precise  data  over  all  sensible  domains.  Since  data 
from  multiple  practical  sensors  may  be  repetitious,  complementary,  or  conflicting, 
techniques  have  been  developed  to  synergistically  merge  the  information  to  provide 
the  most  realistic  view  of  the  “real”  world. 

Three  categories  of  techniques  have  been  developed  to  address  the  fusion  prob¬ 
lem.  The  first  uses  AI  techniques  that  were  de%-eloped  to  facilitate  reasoning  under 
uncertainty.  This  technique  uses  processed  data  that  may  have  been  refined  by 
Kalman  filters.  The  second  technique  is  a  hybrid  one  that  attempts  to  address  both 
the  post-filter  RUU  techniques  as  well  as  the  processing  of  the  raw  data  that  oc¬ 
curs  within  the  filters.  The  last  technique  concentrates  on  the  processes  that  go  on 
within  the  Kalman  filter  system,  using  expert  knowledge  to  make  improvements  in 
performance. 

2.2. 1  Reasoning  with  uncertainty  techniques.  A  fairly  comprehensive  review 
of  current  work  in  handling  uncertainty  in  expert  systems  has  been  written  by  P.P. 
Bonissone  [3],  He  concludes  that  there  exists  two  basic  approaches  to  representing 
uncertainty:  numerical  and  symbolic  characterizations  [3,  p.2], 

2.2. 1.1  Numeric  Approaches.  Numerical  approaches  are  characterized 
by  values  represented  by  a  single  number  or  an  interval.  This  method  is  most  useful 
when  the  relationships  and  independence  between  variables  can  be  fully  described. 
Since  specific  numbers  are  involved,  a  calculus  is  usually  developed  for  combining 
and  separating  values  of  interest.  The  use  of  one  type  of  numerical  characteriza- 
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Evidential  Reasoning.  Work  by  Thomas  Garvey,  et  al.,  has  fo¬ 
cused  on  the  use  of  “evidential  propositional  calculus”  [6,  p.319]  for  the  purpose  of 
electromagnetic  signal  identification.  This  technique  is  known  as  Evidential  Reason¬ 
ing  and  considers  both  reasons  for  supporting  and  negating  certain  conclusions.  This 
method  is  based  primarily  upon  the  Dempster-Shafer  theory  [3,  p.  ">].  The  represen¬ 
tation  for  each  proposition  has  a  lower  and  upper  value.  The  lower  value,  denoted 
as  s(a),  represents  the  support  of  that  proposition.  The  upper  value,  denoted  as 
p(a),  represents  the  plausibility  of  the  proposition.  “Support  may  be  interpreted  as 
the  total  positive  effect  a  body  of  evidence  has  on  a  proposition,  while  plausibility 
represents  the  total  extent  to  which  a  body  of  evidence  fails  to  refute  a  proposition” 
[6,  p.320].  Using  this  notation,  a  proposition  A  may  be  written  as  A[s( A),p( A)].  The 
following  examples  further  explain  the  use  of  this  notation: 


A  [0,  1] 
A  [0,  0] 
A  Cl,  1] 
A  [. 2  ,  1] 
A  [  0, .8] 
A  [.2, .8] 

A  [.5,. 5] 


No  knowledge  at  all  about  A. 

A  is  false. 

A  is  true. 

Evidence  partially  supports  A. 
Evidence  partially  supports  \={A> . 
The  probability  that  A  is  true  is 
between  0.2  and  0.8. 

The  probability  that  A  is  true  is 
exactly  0.5. 


The  use  of  this  notation  provides  a  continuum  of  representation  from  the  one 
extreme  of  Boolean  logic  (which  allows  only  true  or  false  conditions)  to  the  other 
extreme  of  Bayesian  logic  (which  allows  for  uncertainty).  Given  this  notation  and  two 
statements  A[s(A),p(A)]  and  B[s(B),p(B)],  three  basic  logical  functions  are  defined 
as  [3.  p .9] : 


Intersection:  C  =  AND(A,B) 

where  s(C)  =  max(0,  s(A)+s(B)-l) 
and  p(C)  *  min(p(A),  p (B) ) 

Union  :  C  =  0R(A,B) 


where  s(C)  =  max(s(A),  s(B)) 
and  p(C)  =  min(l,  p(A)+p(B)) 


Negation  :  C  =  NOT(A) 

where  s(C)  =  1  -  p(A) 
and  p(C)  =  1  -  s(A) 

This  technique  was  used  to  fuse  data  from  simulated  passive  electronic  support 
measures  (ESM)  sensors  [6,  p.322].  These  sensors  would  identify  in  which  radio 
frequency  (RF)  and  pulse  width  (PVV)  ranges  the  threat  radars  were  operating. 
This  example  could  be  viewed  as  the  fusion  of  threat  identification  information  from 
an  RF  sensor  and  a  PW  sensor.  The  system  is  provided  with  a  knowledge  base 
of  unique  RF  -  PW  signatures  for  the  known  threats.  When  a  simulated  threat 
radar  signal  is  received,  the  RF  and  PW'  characteristics  of  the  signal  are  compared 
with  those  in  the  database  resulting  in  pairs  of  RF  and  PW'  support  and  plausibility 
values.  By  combining  the  likelihoods  that  the  threat  has  an  RF  like  that  of  Threat 
X  and  a  PW  like  that  of  Threat  X,  a  unified  set  of  support  and  plausibility  values 
may  be  assigned.  By  repeating  this  for  each  threat  in  the  knowledge  base,  a  best 
estimate  for  the  threat  identification  could  be  reached. 

This  technique  may  yield  useful  results  when  identifying  a  target  from  a  table 
of  targets.  However,  the  problem  of  target  tracking  does  not  lend  itself  to  this  type 
of  selection  process.  Since  a  target  could  be  at  any  place  within  a  range  of  locations, 
a  single  datum  would  be  insufficient  for  generating  a  support  -  plausibility  pair. 

2.2. 1.2  Symbolic  Approaches.  The  symbolic  approach  lends  itself  to 
those  applications  where  the  information  provided  tends  to  be  subjective  or  have 
imprecise  relationships  between  variables  [3,  p.2].  The  basic  premise  of  each  of  t  hose 
representations  is  to  define  variables  in  such  a  way  that  they  can  be  combined  to¬ 
gether  in  a  logical  and  intuitive  manner.  The  use  of  a  symbolic  characterization, 
specifically  the  Theory  of  Endorsements,  has  been  considered  by  the  Threat  Expert 
Analysis  System  (1  EAS)  [lf)j  program  and  bv  Shafer  [  1 7] . 
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Threat  Expert  Analysis  System.  The  Treat  Expert  Analysis  Sys¬ 
tem  (TEAS)  program  is  also  investigating  the  use  of  sensor  fusion  in  the  fighter  air¬ 
craft  domain.  For  this  program  . .  the  desired  results  are  recommended  solutions 
for  threat  response  and  threat  prioritization  in  real  time'’  [19,  p.  1  ] .  As  the  author 
rightly  points  out,  “In  the  threat  assessment  and  reaction  domain,  as  in  any  domain 
which  includes  aspects  of  the  real  world,  uncertainty  plays  a  major  role.  Virtually 
any  piece  of  information  is  uncertain  to  some  degree”  [19,  p.2].  More  specifically, 


the  pilot’s  uncertainty  falls  into  one  of  nine  categories: 

Direct  Ignorance:  The  knowledge  of  a  problem  with  no  knowledge  of  the  details. 
For  instance,  a  pilot  may  know  there  is  a  threat  in  the  environment,  but  have 
no  information  about  its  location. 

Indirect  Ignorance:  The  lack  of  knowledge  that  a  problem  even  exists. 

Partial  Knowledge:  The  knowledge  of  some,  but  not  all,  of  the  details  surrounding 
a  specific  problem. 

Insufficient  Precision:  The  resolution  of  the  sensed  data  is  not  adequate  to  make 
some  determination.  For  instance,  range  information  from  a  radar  may  be  so 
coarse  that  two  targets  flying  in  close  formation  cannot  be  separated. 

Inaccurate  Sensors:  Sensors  that  provide  biased  or  wrong  information.  As  an  ex¬ 
ample,  an  INS  will  tend  to  drift  producing  results  that  are  increasingly  biased. 

Unreliable  Sensors:  Sensors  that  do  not  always  operate  correctly.  Since  any  sen¬ 
sor  can  malfunction,  the  results  from  that  sensor  should  be  viewed  stochasti¬ 
cally  and  not  deterministically. 

Countermeasures:  All  types  of  active  and  passive  means  used  by  an  opponent  to 
deny,  degrade,  or  deceive  a  sensor. 

Conflicting  Information:  Inconsistent  information  that  is  presented  by  two  or 
more  sensors.  This  can  occur  when  one  or  more  of  the  sensors  suffers  from 
one  of  the  other  types  of  sensor  uncertainty.  For  instance,  if  the  radar  is  being 
jammed  through  the  use  of  decoys,  the  radar's  returns  will  probably  conflict 
with  those  of  the  IRST. 
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Old  Information:  The  time  dependence  of  data  anti  the  fact  that  data  from  various 
sources  is  probably  not  sensed  at  the  exact  same  time.  This  is  especially  true 
in  the  rapidly  changing  fighter  aircraft  domain  [19,  p .3] . 

In  developing  a  framework  for  solving  the  problems  of  situation  assessment 
and  reaction,  the  authors  have  concluded  that  symbolic  methods  of  uncertainty 
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representation  should  be  used.  The  purpose  of  the  situation  assessment  function 
is  to  develop  as  many  logical  interpretations  of  the  sensed  data  as  possible,  giving 
each  one  some  type  of  certainty  or  likelihood  value.  The  function  of  reaction  is  to 
determine  the  best  course  of  action  that  will  “handle"  as  many  problems  as  possible. 
“Often,  what  is  sought  is  not  necessarily  a  course  of  action  which  "wins'  in  each 
interpretation,  but  rather  one  which  does  not  "lose"  in  any  interpretation"  [19,  p.G]. 

Whiteboard.  Architecture.  The  use  of  symbolic  reasoning  in  devel¬ 
oping  a  framework  for  sensor  fusion  has  also  been  researched  by  Steven  Shafer,  et 
al.  [IT],  this  time  in  the  development  of  an  intelligent  mobile  robot.  Their  work 
was  done  at  the  Carnegie- Mellon  University  Vision  Lab  using  a  mobile  robot  vehicle 
called  NAVLAB.  The  result  has  been  the  development  of  a  “whiteboard"  architec¬ 
ture  having  distributed  concurrent  software  modules  and  a  database/communication 
system  for  fusing  sensed  data  [17.  p.l],  A  “whiteboard”  architecture  is  defined  as 
being  “. . .  heterarchical  like  a  blackboard,  but  each  module  runs  in  parallel  with  the 
module  programmer  controlling  synchronization  and  data  retrieval  requests  as  best 
suited  for  each  module"  [17.  p .5] .  This  architecture  readily  lends  itself  to  a  parallel 
implementation. 

The  purpose  of  Shafer's  research  is  to  develop  an  autonomously  navigating 
vehicle.  Sensors  used  by  the  system  include  mono  and  stereo  TV  cameras,  an  ERIM 
laser  rangefinder,  and  sonar  equipment.  Each  type  of  sensor  has  a  dedicated  SUN 
workstation  that  is  linked  to  the  other  SUNs  using  an  Ethernet  connection.  A  fourth 
SUN,  also  connected  via  the  Ethernet,  is  used  to  maintain  the  local  map  database 
and  for  planning  the  activities  of  the  system. 

The  NAVLAB  system  reportedly  uses  three  types  of  sensor  fusion.  These  are 
competitive,  complementary,  and  independent.  Competitive  data  either  reinforce  or 
conflict,  during  the  fusion  process.  This  type  of  fusion  is  often  used  when  the  sensors 
produce  the  same  type  of  data.  For  example,  two  sonar  sensors  may  locate  the  same 
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obstacle  at  slightly  different  positions.  Complementary  data  is  returned  when  the 
sensors  have  differing  characteristics  (e.g.,  field  of  view,  resolution,  range,  etc.).  In 
this  case,  sensors  are  used  individually  to  enhance  their  strengths  while  attempting 
to  cover  their  weaknesses.  As  an  example,  the  TV  cameras  may  be  used  to  coarsely 
locate  an  obstacle  following  which  the  laser  rangefinder  is  used  to  precisely  determine 
the  obstacles  position.  Lastly,  independent  data  is  derived  from  a  single  sensor  in  a 
kind  of  “non-fusion"  mode  in  which  a  single  sensor  is  used  to  perform  a  specific  task 
[17,  p.  18] .  For  example,  when  looking  directly  into  a  bright  sunset,  only  one  sensor 
(possibly  the  sonar  equipment)  may  be  able  to  detect  obstacles. 

When  fusing  data.  NAVLAB  primarily  uses  the  complementary  technique.  As 
the  system  attempts  to  navigate  through  a  portion  of  road  by  finding  an  obstacle- 
free  path,  specific  sensors  are  used  in  a  basically  programmed,  independent  manner. 
When  these  sensors  "need  help"  due  to  limitations  in  coverage,  etc.,  other  sensors 
are  activated  to  provide  the  missing  data.  While  this  complementary  type  of  data 
fusion  may  work  well  in  a  relatively  slow-moving,  simplistic  "threat"  environment, 
its  use  may  not  lie  indicated  in  the  dynamic  and  complex  environment  of  the  modern 
fighter  aircraft.  In  this  more  demanding  domain  where  sensor  returns  may  often  be 
competitive  in  nature,  sensor  fusion  will  often  be  required  at  the  signal-level.  Thus, 
the  problem  is  not  simply  connecting  data,  but  one  of  fusing  them  together. 

While  symbolic  reasoning  may  be  appropriate  in  solving  the  situation  assess¬ 
ment  and  reaction  problems,  this  technique  may  not  work  for  the  sensor  fusion 
problem.  The  use  of  symbolic  reasoning  is  intuitively  closer  to  how  humans  think 
through  problems  as  opposed  to  the  numerically-based  sensor  domain.  As  such, 
symbolic  representations  are  indicated  on  the  "pilot-side"  of  the  Pilot's  Associate 
system.  This  includes  the  PYI,  Mission  Planner.  Tactical  Planner,  and  possibly 
even  the  Situation  Assessment,  modules.  The  "sense  side"  of  the  system,  including 
processing  of  the  signal  within  the  sensor  as  well  as  the  Sensor  Fusion  module  lend- 
itself  to  a  numeric  representation. 

I!) 


2.2.2  Composite  Approach.  Ronald  Yannone  has  chosen  to  consider  both  the 
numeric  sensor  data  processing  and  the  symbolic  expert  reasoning  processing  within 
the  same  system.  As  he  states: 

It  is  anticipated  that  a  high  percentage  of  the  fusion  function  will  be 
computational  and  that  some  “expert”  reasoning  might  be  used.  The 
fusion  expert  would  bring  to  bear  the  following  features  in  order  to  assign 
a  quality  factor  to  each  composite  track  file  entry:  mission  information, 
geography,  potential  “intent”  of  the  target,  probability  of  detection  and 
false  alarm,  a  priori  information  regarding  anticipated  threats,  the  threat 
class,  kinematic  state  vector,  and  sensor  measurement  accuracies  [23. 
p.  1454]. 

The  suggested  framework  for  implementing  this  system  is  shown  in  Figure  2. 
The  sensor  data  are  "cleaned  up”  using  dedicated  signal  processors.  From  there, 
the  signals  are  sent  to  track  processors  so  that  threat  track  files  can  be  developed. 
The  common  reference  alignment  block  performs  the  necessary  temporal  and  spatial 
shifts  of  the  track  files  from  the  various  sensors.  Following  this,  the  tracks  are 
merged  together  in  the  intertrack  file  association  module.  The  fusion  that  occurs 
here  is  performed  by  one  or  more  Kalman  filters.  The  resulting  composite  track  file  is 
then  sent  to  the  Situation  Assessment/ Response  Management  module  for  evaluation. 
This  module  performs  a  function  similar  to  that  of  the  Situation  Assessment  and 
Tactical  Mission  Planner  modules  of  the  Pilot's  Associate  (see  Figure  1).  At  this 
point,  a  rule- based  expert  system  utilizes  symbolic  knowledge  to  reason  over  the  new 
information,  update  the  database,  and  suggest /initiate  intelligent  responses,  this 
is  similar  to  the  Hybrid  Multisensor  Fusion  Data  Flow  Model  developed  by  .Julius 
Reiner  [16.  p.l  l  lt)]. 

The  process  graphically  presented  in  Figure  2  clearly  separates  the  -eu-or 
fusion  process  which  occurs  on  the  "sensor- side”  from  the  situation  assessment  func¬ 
tion  which  is  performed  on  the  "human-side"  ,dter  the  composite  track  ha'  been 
created.  I  he  validitv  o!  the  results  produced  by  the  situation  assessment  expert 
svstem  is  st  rough'  rol.t  i  ed  to  the  i  jualit  y  I  accuracv.  precision .  etc.'  <>1  the  com  posit  e 
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figure  2.  Multisensor  System  Block  Diagram 
[2d.  p.l  lobj. 


track  file.  This,  in  turn,  is  dependent  upon  how  the  tracks  are  being  fused  together. 
U  hat  criteria  is  used  to  fuse  the  tracks'.’  Is  any  significant  information  being  lost  in 
this  fusion  process?  The  Air  Force  Wright  Aeronautical  Laboratories  (AFWAl.i  is 
i ('searching  ways  to  intelligently  control  the  data  fusion  process  that  occurs  within 
a  Kalman  filler  system.  I’art  of  this  work  is  outlined  in  the  following  se<  t  i<  >i  i . 


2.2.3  Multtpl  t  hat  man  liltcv  Approach.  Research  is  current  !v  being  spon¬ 
sored  by  Ah  UAL  to  investigate  the  use  of  an  expert  system  in  choosing  between 
combinations  of  navigation  sensors  that  pass  through  Kalman  filters  [2,  p.l].  I  bis 
project,  known  as  the  Adaptive  Tactical  Navigation  |  A  I  N)  system,  is  provided  with 


dgoiilhllls  to  ellei  li\elv  manage  the  milllis 


,  and 

desirabilit  y 

of 

1 1  ^  i  1 1 1» 

V.T  I  1<  HIS 

The 

pm  p<  >se  i  >1 

tie 

■  A  1  N 

sy-m  m 

hm<\u 

es  and  ad\ 

.\U< 

ed  na\ 

(gal  i'  ai 

im\  it;; 

it  ion  sillies 

ol 

|  UUIlN  ! 

!  ai  le  a  I 

-v es  I'eswo* 


aircraft”  [2,  p.lj. 


The  navigator  portion  of  the  ATN  system  receives  data  from  various  sensors: 

1.  INS  (Inertial  Navigation  System). 

2.  GPS  (Global  Positioning  System). 

3.  Barometric  Altimeter. 

4.  TERCOM  (Terrain  Contour  Matching). 

5.  SITAN  (Sandia  Inertial  Terrain  Aided  Navigation). 

6.  JTIDS  Datalink  (Joint  Tactical  Information  Distribution  System). 

The  ATN  uses  a  Basic  Navigation  System  (BNS)  that  has  a  set  of  four  Kalman 
filters  to  track  the  performance  of  various  combinations  of  sensors.  This  is  shown 
graphically  in  Figure  3.  (Note:  The  INS/ Barometric  Altimeter  combination  is  not. 
strictly  speaking,  considered  a  Kalman  filter  [2,  p.4].)  The  resulting  states.  SO 
through  S10.  provide  ‘'best-guesses”  of  the  current  kinematic  state  of  the  aircraft.  In 
conjunction  with  the  BNS  is  the  Expert  Navigation  System  (ENS)  which  monitors 
the  operation  of  the  BNS  to  help  identify  any  problems  or  special  situations  that 
may  arise. 

Once  the  ENS  determines  that  the  currently  selected  sensor  combination  is 
providing  inaccurate  results,  it  determines  the  location  of  the  fault  [2.  p.oj.  Once 
the  fault  has  been  located,  the  ENS  will  determine  if  the  navigational  data  should 
be  taken  from  a  different  sensor  combination  and.  if  so.  which  one.  I'o  perform 
this  function  the  ENS  is  given  a  priori  knowledge  of  the  quality  of  various  sensor 
combinations.  This  knowledge  is  represented  in  Table  2.  As  an  example,  if  the 
primary  mode  (SO)  becomes  non-operational.  the  first  backup  modes  to  be  considered 
are  SI  and  S2  depending  upon  where  the  fault  was  located. 

Tin'  sensor  fusion  technique  selected  by  A  FWA  I.  attempts  to  enhance  the  lunc- 
I  ion  of  Kalman  filters  bv  using  expert  knowledge. 


Table  2.  ATN  Navigation  Modes. 


Symbol 

Sensors 

SO 

INS.  GPS4 

SI 

GPS4 

S2 

INS.  GPS3 

S3 

INS,  SITAN 

S4 

INS,  Doppler,  SAR/LANTIRN 

S5 

GPS3.  Doppler,  Baro 

S6 

GPS3.  Baro 

S7 

INS.  Doppler 

S8 

INS,  SAR/LANTIRN 

S9 

INS 

S10 

Doppler.  LANTIRN 

Source:  [2.  p.4] 

The  basic  philosophy  of  the  Expert  Navigator  is  to  integrate  the  exper¬ 
tise  and  mission  perspective  of  flight  crews  into  the  navigation  process, 
along  with  the  traditional  algorithm-based  techniques  for  managing  the 
aircraft  navigation  suite.  .  . .  Techniques  developed  in  Al  are  appropri¬ 
ate  to  integrate  this  human  perspective  and  knowledge  gained  through 
experience  into  the  knowledge  base  of  the  Expert  Navigator.  It  is  rec¬ 
ognized,  however,  that  algorithmic  approaches  such  as  Kalman  filtering 
provide  information  needed  to  form  a  logical  basis  for  subsequent  action 
on  the  part  of  the  flight  crew.  Consequently,  these  algorithmic  tools  are 
integrated  into  but  not  supplanted  bv  the  overall  Al  framework  7.  p.3-1  . 

As  the  BNS  updates  navigational  information,  the  ENS  checks  for  anomalies 
(e.g..  sudden  changes  in  location/ velocity  estimates  or  large  error  signals  from  the 
Kalman  filter).  Once  an  estimate  becomes  "significantly  poor."  the  A  1  N  system  uses 
the  ENS  to  identify  the  source  of  the  problem.  If  the  problem  is  believed  to  lie  with 
either  the  external  source  of  the  data  or  with  the  sensor  of  that  data,  the  sy-tem 
can  choose  a  different  navigation  mode.  1  ins  technique  makes  sense  ri  tie-  >  a.-e 
of  navigational  data.  The  normally  highly  accurate  CPS  updates  provide  'MtC 
i  n  lor  mat  ion .  ( )n  I  v  when  I  Ins  source  cannot  be  reeei  \  ed  i  e.g..  sensor  l.i  u  u  i  <  •.  eie.  1 1  on  i< 
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Using  a  pre-sorted  (i.e.,  primary,  secondary,  etc.)  Kalman  filter  selection  crite¬ 
ria  would  not  be  appropriate  for  target  tracking.  No  sensor  stands  out  in  the  target 
tracking  problem  as  the  GPS  source  did  in  the  navigational  problem.  In  addition, 
target  tracking  is  often  done  with  multiple  Kalman  filters,  each  tuned  for  a  differ¬ 
ent  target  trajectory  (e.g.,  benign,  harsh  vertical  maneuver,  etc.)  Some  mechanism 
must  be  used  to  not  only  select  between  Kalman  filters  receiving  data  from  different 
sensors,  but  also  select  between  filters  employing  differing  target  trajectory  models. 
Since  target  trajectories  can  change  rapidly  in  the  air-to-air  combat  environment, 
this  filter  selection  process  must  also  proceed  expeditiously. 

The  remainder  of  this  paper  will  present  a  more  thorough  overview  of  Kalman 
filters  and  the  development  of  a  new  Kalman  filter  selection  process.  This  selection 
process  is  a  knowledge- based  system  that  uses  rules  formulated  by  a  Kalman  filter 
expert. 


at  time  t,.  The  value  £(t")  is  the  filter’s  best  prediction  of  the  actual  measurement 
z(t,).  This  prediction  is  computed  by  the  filter  at  time  t~ .  The  difference  between 
the  actual  measurement  and  the  predicted  measurement  is  known  as  the  residual  and 
is  identified  as  r(it).  The  residual  “...is  then  passed  through  an  optimal  weighting 
matrix  A',  and  used  to  correct  x(t~ ),  the  best  prediction  of  the  state  at  time  instant 
t,  before  the  measurement  is  taken  at  time  [13].  For  a  full  explanation  of  the 
filter  and  associated  notation,  see  [10]  and  [11].  The  residual  may  be  likened  to  an 
error  signal,  although  strictly  it  is  not  since  the  original  measurement,  has 

uncertainty  associated  with  it. 

The  magnitudes  of  the  residuals  are  related  to  how  well  the  matrices  model 
the  characteristics  of  events  in  the  real-world  system.  For  example,  two  filters  could 
be  developed  to  track  a  target  from  radar  data.  One  filter  could  be  tuned  for  targets 
moving  at  constant  %-elocity  while  the  other  could  be  tuned  for  targets  characterized 
bv  constant  acceleration.  If  the  target  did  indeed  travel  at  constant  acceleration, 
the  “goodness”  of  the  corresponding  filter  should  be  indicated  by  the  relatively  low 
residuals  during  its  updates.  The  filter  having  the  less  appropriate  set  of  assumpt  ions 
(i.e.,  that  the  target  would  have  a  constant  velocity)  is  expected  to  have  larger 
residual  values. 

Filters  could  also  be  developed  to  combine  data  from  different  types  of  sensors, 
each  weighing  such  factors  as  individual  sensor  reliability  and  precision  and  the 
believed  accuracy  of  the  filter  model.  While  sets  of  single-sensor  filters  could  be 
developed,  the  standard  implementation  is  to  develop  one  set  of  filters  having  access 
to  all  related  sensor  data  [13].  Allowing  more  than  one  sensor  access  to  the  Kalman 
filters  provides  a  mechanism  for  sensor  fusion. 

Kalman  filter  residuals  also  provide  the  added  benefit  of  indicating  when  a 
sensor  has  begun  producing  poor  data. 

When  all  measuring  devices  are  operating  correctly,  the  difference  sig¬ 
nals  entering  the  optimal  gain  matrix. ..[i.e..  residuals], ..should  be  white 


BUWJA^J,-V_"JWiUUUUyt^WyUUUW,J(  W *>  ■>  TE  ^T5T7 ».  ir*  x-avr  7*  «"* » ' ' » 


> 


I  sequences  with  zero  mean  and  predictable  covariance  (or  standard  devi¬ 

ation).  If  any  of  the  residuals  consistently  differ  from  this  description,  a 
measuring  device  failure  can  be  detected  and  often  isolated  to  the  exact 
device  that  is  at  fault  [12,  p.39]. 


The  actual  cause  of  the  problem  may  be  due  to  a  sensor  malfunction,  jamming,  or 
some  other  change  in  the  system  of  interest  or  its  environment  that  invalidates  a 
model  which  had  previously  been  adequate. 

3.2  Current  filter  selection  process. 

In  a  multiple-filter  system,  each  filter  develops  its  own  best  estimate  of  the 
desired  variables  (e.g.,  target  location  and  velocity)  as  well  as  a  residual  associated 
with  that  estimate.  An  example  of  this  type  of  system  is  shown  in  Figure  5.  I  he 
final  state  estimate  provided  by  the  multiple-filter  system  is  based  upon  a  weighted 
addition  of  the  individual  filter  estimates.  This  weighting  function  is  actually  a  con¬ 
ditional  probability  derived  from  a  Bayesian  estimation  of  the  residuals  [ll.  SecHl]. 
This  Bayesian  estimation  is  the  conditional  probability  that  the  parameter  value 
produced  by  each  filter  is  in  fact  the  best  estimate  available,  based  upon  that  fil¬ 
ler's  residual  values  up  to  that  time.  This  value,  known  as  the  residual's  hypothesis 
conditional  probability,  shall  be  referred  to  as  the  residual's  probability.  The  sum  of 
these  probabilities  across  all  filters  is  one.  The  final  weighted  estimate  is  referred  to 
as  the  Bayesian  estimate. 

An  alternative  to  weighting  the  multiple  Kalman  filter  estimates  is  to  select 
the  estimate  from  the  filter  with  the  largest  residual  probability.  This  technique  is 
known  as  maximum  a  posteriori  (MAP)  state  estimation  [9.  p.20].  As  an  example, 
assume  filters  A  and  B  have  residual  probabilities  of  0.6  and  0.4.  respectively.  Instead 
of  computing  a  weighted  average  of  the  filter  state  estimates  (O.Gi.j  O.  l.i^i.  just 
select  filter  .Vs  estimate.  A  Monte  Carlo  simulation  comparison  of  the  Bayed an 
and  MAP  estimates  showed  that,  at  least  for  the  Kalman  filter  models  and  target 
trajectories  used,  the  techniques  resulted  in  very  similar  performance  fit.  p.sT.  l  he 
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Figure  5.  Multiple  model  filtering  algorithm 
[II.  p-l'J-'i], 
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MAP  estimate  technique  will  be  the  one  considered  throughout  the  remainder  of  this 


report. 


3.3  Problems  with  current  selection  process. 


Dr.  Maybeck  [14]  has  identified  two  problems  that  can  occur  when  selecting 
the  best  filter  to  use  in  a  multiple-filter  system.  (The  “better”  and  “best”  filters 
are  those  deemed  that  way  by  the  expert.)  The  first  problem  he  identified  was  a 
tendency  for  certain  filters  to  “hold  on”  to  the  system  longer  than  they  should. 
Because  of  this,  there  can  be  a  delay  in  switching  to  a  better  filter.  The  second 
problem  he  identified  could  occur  when  a  new  filter  needed  to  be  selected.  Under 
certain  situations,  the  filter  with  the  new  highest  residual  probability  may  not  be  the 


correct  one  to  choose.  Dr.  Maybeck  stated  that  he  and  other  filter  designers  could 


do  a  better  job  at  selecting  filters  than  the  original  system  did. 


As  an  example,  consider  a  Kalman  filter  system  having  three  filters  designed 
to  provide  location  information  about  a  target.  Assume  that  filter  A  has  a  high- 
precision.  narrow- view  model  (this  filter  should  be  used  when  the  target  is  not  ma¬ 
neuvering).  filter  B  has  a  medium-precision,  medium-view  model  (this  filter  should 
be  used  when  the  target  is  maneuvering  moderately),  and  filter  C  has  a  low-precision, 
wide- view  model  (this  filter  should  be  used  when  the  target  is  harshly  maneuvering). 
The  target  has  been  performing  a  high-g  maneuver  so  the  system  has  been  selecting 
the  state  estimate  from  filter  C.  As  the  target  ceases  accelerating,  the  residual  prob¬ 


ability  of  filter  C’  begins  to  decrease  while  those  of  filters  A  and  B  increase.  Since 


the  target  has  stopped  accelerating,  the  best  filter  to  select  would  be  filter  A.  How¬ 
ever.  the  actual  system  will  wait  for  the  residual  probability  of  filter  B  to  rise  above 
that  of  filter  C.  At  that  point  the  system  will  select  filter  B.  Eventually  the  residual 
probability  of  filter  A  will  surpass  that  of  filter  B.  leading  to  the  final  selection  of 
filter  A.  This  delay  in  selecting  the  best  filter  results  in  sub-optimal  performance. 
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3-4  Proposed  filter  selection  criteria. 


To  arrive  at  a  solution,  an  expert  must  use  information  relative  to  the  problem. 
The  information  provided  by  Kalman  filters  (i.e.,  the  raw  residual  data)  is  not  in  an 
appropriate  format  for  an  expert  to  select  a  filter.  An  example  of  raw  residual  data 
is  shown  in  Figure  fj.  Each  filter  produces  X  and  Y  residuals  widt  h  correspond  to 
t  lit'  X  and  Y  target  location  estimates  developed  by  the  filters.  (X  and  'l  iefei  hoie 
to  the  target's  apparent  azimuth  and  elevation  from  the  ground-based  sensor's  point 
of  view.)  Fhe  question  then  becomes,  “Ilow  can  the  data  be  processed  so  that  the 
expert  can  make  a  decision?"  In  this  report,  two  data  processing  techniques  were 
investigated.  The  fust  technique  used  stat  istical  informal  ion  concerning  t  he  residuals 
while  the  other  used  the  residual  probability  data.  (The  raw  residual  data  from  the 
five  Kalman  ii Iters  for  trajectories  one  through  six  are  presented  in  Appendix  A.) 
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figure  ti.  Kahn. in  filler  Number  ( )ne  h’esidual  Data  limn  liajertmv  |  v.n. 


>  3. 4-1  Statistical  selection  criterion.  One  approach  to  selecting  the  best  Kalman 

filter  would  be  to  perform  some  type  of  temporal  analysis  of  previous  filter  residu¬ 
als.  looking  for  some  type  of  trend.  Dr.  Maybeck  stated  that  information  available 
in  the  residuals  could  conceivably  be  used  to  select  a  filter  that  would  provide  an 
estimate  as  good  as,  and  possibly  better  than,  the  filter  having  the  highest  residual 
probability.  The  candidate  residual  statistics  chosen  by  Dr.  Maybeck  were: 

1.  Mean. 

2.  Slope. 

3.  Percent  mean  crossing. 

4.  Gaussianess. 

5.  Scaled  residual. 

(i.  Average  scaled  residual. 

These  statistics  (except  for  Scaled  residual)  were  computed  using  the  previous 
N  residual  points.  N  was  originally  selected  by  the  expert  to  be  13.  This  corre¬ 
sponded  to  a  0.5  second  time  interval  within  the  8.0  second  simulation.  Mean  refers 
to  the  average  of  the  previous  N  residual  values.  Slope  is  the  slope  of  the  line  that 
is  the  least  squares  fit  approximation  of  the  last  N  residual  values.  F.xatuples  ,,f 
these  statistics  are  shown  in  Figures  7  and  8.  Percent  mean  crossing  is  calculated 
by  first  counting  the  number  of  times  the  last  N  residuals  crossed  the  mean  value  of 
those  N  residuals.  Thus  if  r(t,)  and  r(f1+1)  were,  respectively,  less  than  and  greater 
than  the  average  of  the  previous  N  residuals,  the  count  would  increase  by  one.  1  fib 
total  is  incremented  by  one  and  then  divided  by  N.  resulting  in  the  percent  mean 
crossing  value.  This  statistic  was  used  as  an  estimate  of  signal  whiteness.  1'he 
higher  the  percent  mean  crossing,  the  more  likely  the  values  are  not  time-correlated 
(and  therefore  are  white).  Gaussianess  refers  to  some  type  of  numeric  representation 
of  the  likelihood  that  the  last  ,\  residual  data  points  had  a  Gaussian  distribution. 
Scaled  residual  is  the  value  of  the  square  of  the  residual  divided  be  tin  as'oiiai>-d 
component  of  .1.  .1  is  the  filter-computed  covariance  matrix  of  residual  n  /  i  Kir 
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Figure  4)  conditioned  on  residuals  taken  through  (For  more  information  see 

[10,  Section  5.3].)  Average  scaled  residual  is  the  average  of  the  previous  X  scaled 
residuals.  Dr.  Maybeck  stated  that  the  residuals  coming  from  a  filter  with  a  very 
good  internal  model  and  assumed  parameters  should  have  zero  mean  and  zero  slope, 
be  white,  have  a  Gaussian  distribution,  and  have  scaled  residual  values  equal  to  one 

[13]. 

Bv  computing  these  statistics  and  comparing  them  to  the  desired  characteris¬ 
tics,  the  filter  selection  process  could  theoretically  select  the  filter  having  attributes 
most  like  those  of  the  ideal  filter.  In  addition,  any  information  concerning  relation¬ 
ships  between  filters  could  also  be  included  as  part  of  the  selection  process.  For 
example,  a  developer  may  conclude  that  when  filter  X  residuals  have  a  negative 
mean  and  filter  Y  residuals  have  a  large  slope,  that  the  system  should  select  the 
state  estimate  from  filter  Z. 

3-4- 2  Residual  probability  selection  criterion.  An  alternative  selection  guide¬ 
line  would  be  to  analyze  the  residual  probabilities  for  information  germane  to  the 
filter  selection  process.  An  example  of  the  residual  probabilities  developed  by  an 
MMAF  system  is  shown  in  Figure  9.  The  abscissa  of  this  figure  runs  from  zero  to 
eight  seconds  (with  marks  every  half  second),  while  the  ordinate  runs  from  zero  to 
one.  Ihe  figure  shows  the  five  filter  residual  probabilities  superimposed  on  each 
other  with  numbers  provided  to  differentiate  between  the  probability  curves. 

The  current  technique.  MAP.  selects  the  filter  with  the  highest  probability. 
Thus,  in  Figure  9.  MAP  would  first  select  filter  number  one  until  just  after  one  second 
at  which  time  it  would  switch  to  filter  number  four.  This  would  then  continue  lor  the 
entire  trajectory.  An  expert  system  based  upon  residual  probability  data  could  have 
rules  that  did  more  than  just  find  which  filter  had  the  highest  residual  probability. 
Pules  could  be  tailored  depending  upon  which  filters  had  recently  been  selected.  For 
example,  if  the  svstem  had  been  selecting  filter  number  one  and  suddenly  a  dillerent 
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Figure  9.  Residual  Probabilities  from  Trajectory  Two. 


filter  has  a  residual  probability  that  is  only  slightly  greater  than  filter  one.  t  he  "best" 
filter  may  be  still  filter  number  one.  Rules  could  also  take  into  account  any  tendencies 
of  the  original  system  to  prefer  one  filter  over  another  when  the  parameters  from 
those  filters  may  be  equally  likely.  'For  example,  if  the  original  system  tends  to  go 
toward  filter  two  over  filter  one.  select  filter  one  if  the  filters'  residual  probabilities 
are  "close  enough."  I  his  criterion  may  be  especially  helpful  since  it  dearly  shows 
when  each  filter  “believes  it  has  good  and  poor  estimates. 


3.5  Chosen  filter  scUction  enti  non. 

The  residual  probability  selection  criterion  was  selected  as  the  basis  lor  the 
filter  selection  expert  system. 

The  statistical  process  seemed  very  promising  at  first.  Plots  of  the  statis¬ 
tics  identified  in  Section  3.4.1  were  developed  from  a  multiple-model  Kalman  filter 
software  program  [ L*  1  j .  I  his  program  simulated  five  tuned  I i 1 1 < •  i s .  Kadi  -imulatrd 
eight-second  trajectory  generated  30  plots  (live  filters,  each  having  six  Mai  i>t  n  s  I . 
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The  plots  from  trajectory  two  are  shown  in  Appendix  B.  Certain  gross  characteris¬ 
tics  could  be  identified  in  the  plots.  For  example.  Dr.  Maybeck  stated  that  when  a 
filter  had  a  very  poor  assumed  model,  its  residual  would  have  a  relatively  large  abso¬ 
lute  value.  This  phenomenon  was  exhibited  in  the  mean,  slope,  and  scaled  residual 
plots.  Examples  of  the  mean  and  slope  statistics  are  shown  in  Figures  7  and  8.  In 
trajectory  two,  a  10-g  pull-up  is  initiated  at  time  2.0  seconds.  Since  filter  number 
one  is  tuned  for  benign  targets,  the  residuals  from  this  filter  become  very  poor  in  the 
Y-direction  (elevation)  during  the  10-g  pull-up.  Clearly,  filter  one  is  not  the  filter  of 
choice  between  time  2.2  and  2.6  seconds.  However,  there  were  no  clear  indications 
in  the  statistics  when  a  filter  was  doing  moderately  well  or  better.  Thus,  one  or  two 
filters  could  often  be  ruled  out,  but  this  still  left  several  from  which  to  select.  For 
example,  the  MAP  selection  criterion  adamantly  picked  filter  one  between  time  3.2 
and  3.8  seconds  during  trajectory  two.  Unfortunately,  while  reviewing  the  statistics 
from  each  of  the  filters  (Appendix  B)  over  this  time  interval,  nothing  pointed  to 
filter  one  as  being  the  best.  An  additional  problem  was  the  time-lag  produced  by 
using  previous  filter  residuals  in  developing  most  of  the  statistics.  (Only  the  scaled 
residual  statistic  was  based  solely  on  the  current  residual.)  Initially,  the  previous  15 
residuals  were  used  in  determining  the  residual  mean,  slope,  percent  mean  crossings. 
Gaussianess.  and  average  scaled  residual  values.  These  statistics  were  recalculated 
using  just  the  previous  five  residuals  in  hopes  that  the  resulting  statistics  would  be 
more  responsive  to  changes  in  the  residuals.  A  review  of  the  new  plots  showed  that 
they  were  no  more  helpful  than  the  old  plots. 

Plots  of  the  residual  probability  values  were  also  developed.  These  plots  are 
shown  in  Appendix  C.  Each  plot  contained  live  curves,  representing  the  time  domain 
residual  probabilities  of  the  five  Kalman  filters  during  the  simulation.  From  those 
plots  it  was  clear  which  filter  the  current  selection  technique  would  chose  (the  filter 
with  the  highest  probability)  and  which  filters  had  strong  probabilities,  though  not 
necessarily  the  greatest.  Using  information  available  in  these  [riots,  and  knowledge 


about  the  Kalman  filters  simulated  in  the  software.  Dr.  May  beck  believed  that  he 
could  develop  criteria  to  select  the  best  filter,  enhancing  performance  above  that 
attainable  by  just  using  the  MAP  criterion. 

Since  the  expert  could  develop  rules  based  upon  the  information  available  in 
the  residual  probabilities  plots,  this  was  the  source  of  data  chosen  for  the  expert 
filter  selection  process. 
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IV.  Software  Development. 


4-1  Overview  of  software  system. 

Three  computer  programs  were  developed  as  part  of  the  overall  software  sys¬ 
tem.  These  programs  are  graphically  portrayed  in  Figure  10.  The  Kalman  filter 
program  has  been  adapted  from  the  program  used  by  [21]  and  currently  runs  on  the 
AFIT  ICC  computer.  This  FORTRAN  program  has  been  modified  so  that  the  resid¬ 
ual  probabilities  are  written  to  a  file  (fltrprob).  In  addition,  new  trajectories  were 
added  to  provide  additional  test  cases  for  the  expert  system.  The  file  fltrprob  is  read 
by  both  the  dxpert  system  and  the  SUN  graphics  program,  filtsel.r.  Filtsel.c  draws 
a  grapli  of  the  residual  probabilities  of  each  filter.  This  graphics  program  is  written 
in  C'  and  provides  a  hardcopy  capability.  The  expert  system,  known  as  KRFST 
(Kalman  filter  Residual  Expert  SysTem)  is  written  in  OPS-5  and  runs  on  the  AFIT 
SSC  computer.  The  results  of  the  expert  system  are  saved  in  the  file  KRESTOut. 
This  file  contains  the  filter  selected  by  the  original  system  and  by  KREST.  and  the 
values  of  the  five  filter  residual  probabilities.  If  the  filter  chosen  by  KREST  is  dif¬ 
ferent  than  that  of  the  original  system,  the  KRESTOut  file  also  shows  the  number 
of  the  rule  that  made  that  decision. 

4.2  h'ahnan  filter  software. 

The  goal  of  he  original  Kalman  filter  program  l  Kalresid.f)  was  to  address: 

...the  problem  of  accurately  tracking  the  azimuth  and  elevation  of  a 
highly  maneuverable  airborne  target .  using  outputs  from  a  forward-looking 
infrared  (FLIR)  sensor  as  measurements  [21.  p.lh 

lo  do  this,  the  program  simulates  five  Kalman  filters  receiving  data  from  a  -ingle 
-eusoi .  1  he  lilteis  are  tuned  lor  different  models  of  target-,  l  or  example.  Idter  one 

i-  tuned  for  .1  benign  target,  while  filter  two  i-  tuned  tor  a  harshly  mam-iiveiing 
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target.  Since  the  filters  are  independent,  the  program  could  be  modified  to  allow 
for  multiple  sensors  each  with  its  own  set  of  filters.  Additionally,  the  program  could 
be  adapted  to  allow  for  fusing  simulated  sensor  data  in  individual  Kalman  filters. 
Since  a  “proof  of  concept"  expert  system  could  be  developed  without  adding  this 
multi-sensor  capability,  the  original  program  was  not  modified. 

[he  crux  of  the  tracking  problem  is  to  maintain  high  precision  location  and 
velocity  information  on  the  target  during  benign  phases,  while  not  losing  lock  durinn 
periods  of  harsh  maneuvering  or  sustained  acceleration  [21.  p  i].  By  adaptively 
selecting  the  best  filter,  the  system  should  be  able  to  reach  these  objectives. 

Each  filter  has  a  spatial  tracking  window  and  target  acceleration  model  asso¬ 
ciated  with  it.  The  windows  are  rectangles  with  sides  of  eight  or  20  pixels  <  a  pixel  is 
20  /mads  by  20  /trads).  The  target  acceleration  models  are  tuned  for  either  0-.  Id-, 
or  20- g  maneuvers.  The  characteristics  of  the  five  filters  used  in  the  EUR  trackitm 
software  are  shown  in  Fable  3. 


Table  3.  Simulated  Kalman  Filter  Characteristics. 


Filter 

Number 

F  ield  of 
View 
( az  x  el) 

Target 

Acceleration 

Model 

Target 

Model 

1 

8x8 

0-g 

benign 

•) 

24x24 

20- g 

harsh  maneuver 

3 

8x8 

10-g 

smooth  maneuver 

1 

21x8 

20- g  (az) 

azimuthal  maneuver 

5 

8x24 

20-g  (el ) 

elevational  maneuver 

At  each  time  interval  during  the  simulation,  the  five  filters  develop  state  esti¬ 
mates  of  the  target  based  upon  simulated  FLIR  sensor  data.  The  goal  of  the  expert 
system  is  to  select  the  filter  with  the  best  state  estimate. 


4-3  Selection  of  Expert  System  Approach. 

The  expert  system  could  have  been  developed  using  an  AI  framework,  (e.g.. 
rule- based  or  frame-based  programming),  or  a  conventional  programming  approach, 
(e.g.,  functional  decomposition,  top-down.  etc.).  Discussions  with  the  expert  indi¬ 
cated  that  the  knowledge  would  not  require  an  extensive  decision  tree  or  any  type 
of  inheritance  network.  Thus,  a  traditional  programming  language  could  have  been 
chosen.  However,  an  AI  framework  can  be  especially  helpful  in  developing  rapid 
prototype  software  which  <  racefully  evolves  as  knowledge  is  added  and  deleted.  The 
currently  available  expert  system  shells  can  be  especially  helpful  in  tracing  through 
the  logic  of  the  expert  system  for  debugging  purposes.  This  is  also  very  helpful  in 
the  development  of  rapid  prototype  software. 

Based  upon  the  ease  of  knowledge  encoding  and  subsequent  debugging,  an  A I 
approach  was  selected  as  the  basis  for  the  Kalman  filter  selection  expert  system. 

The  selection  of  the  specific  expert  system  development  tool  was  based  upon 
the  characteristics  of  the  problem  and  availability  of  the  tool.  The  tools  considered 
were:  OPS-5,  ART.  KEE,  and  LISP.  OPS  5  and  ART  are  rule-based  development 
tools.  KEE  provides  a  frame-based  expert  system  language.  The  LISP  compute, 
language  is  very  flexible,  allowing  for  either  type  of  representation. 

Two  factors  led  to  the  selection  of  a  rule-based  approach.  First,  while  con¬ 
sidering  the  feasibility  of  an  expert  system  to  assist  in  the  Kalman  filter  selection 
process.  Dr.  Maybeek  stated  that  lie  believed  he  could  develop  several  "rules  to 
make  filter  selections.  Second,  while  reviewing  the  plots  of  residual  probabilities. 
Dr.  Maybeek  was  able  to  identify  conditions  when  certain  filters  should  be  selected. 
1  hose  conditions  were  usually  described  as  "If  this  and  this  and  this,  then  this.” 
This  type  of  knowledge  is  easily  represented  using  rules.  1'hus,  only  the  rule-based 
lancuaees  and  LISP  were  considered  further. 

1  fie  reina  iiimg  hi  mm  an  es  then  were:  ( )|’S  ">.  \  |v  I  ,  a  ud  LISP.  Alt  lioiiirh  LISP  :■> 
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flexible,  it  is  also  very  simplistic.  If  LISP  was  selected,  some  type  of  inference  engine 
and  conflict  resolution  function  would  need  to  be  developed.  Since  both  OPS-5  and 
ART  had  these  capabilities  built-in,  LISP  was  rejected.  Finally,  since  the  Kalman 
filter  software  was  running  on  an  AFIT  Unix-based  machine.  OPS-5  was  selected 
due  to  its  availability  on  the  AFIT  SSC  computer. 

4-4  Expert  knowledge /Rule  development. 

Once  the  source  of  data  for  the  expert  system  was  established  (residual  proba¬ 
bilities  instead  of  residual  statistics),  the  rules  themselves  were  fairly  easy  to  develop. 
In  general,  the  rules  apply  when  one  filter  is  losing  confidence  in  its  estimates  while 
another  filter  is  gaining  or  when  two  or  more  filters  are  "fighting"  to  be  selected. 
This  latter  case  occurs  when  the  better  filters  have  residual  probabilities  that  remain 
close  in  value  with  no  single  filter  standing  out. 

Depending  upon  the  circumstances,  certain  filters  are  better  to  use  than  other's. 
Since  the  expert  knows  when  it  is  advisable  to  use  certain  filters,  rules  ran  be  devel¬ 
oped  based  upon  this  knowledge.  Thus,  although  the  rules  test  for  certain  residual 
probability  values,  the  underlying  basis  for  the  rules  is  the  expert's  knowledge  about 
the  characteristics  of  the  filters.  Consider  the  five  simulated  Kalman  filters.  Filter 
one  has  a  narrow  beamwidth  and  is  tuned  for  zero-g  maneuvers.  Tims,  this  fitter 
should  be  used  with  benign  targets  to  provide  high  precision  state  estimates.  Filter 
two  has  a  wide  beamwidth  and  is  tuned  for  20- g  maneuvers.  This  filter  is  especially 
useful  when  the  target  is  pulling  a  high-g  maneuver  since  the  large  beamwidth  and 
filter  tuning  should  keep  it  from  losing  track  on  the  target.  Filter  three  has  the  same 
narrow  beamwidth  as  filter  one.  however  this  filter  is  tuned  for  10-g  maneuvers.  This 
filter  is  a  kind  of  compromise  between  the  high  precision  estimate  of  filter  one  and 
the  robust  tracking  capability  of  filter  two.  Filter  four  has  a  wide  beamwidth  in  az¬ 
imuth  and  a  narrow  one  in  elevation.  Ih is  allows  tfi(>  filter  to  track  tann  '  -  that  ..te 
accelerating  primarily  in  the  azimuth  direction.  Filter  live  is  just  the  opposite.  •  hi- 


filter  has  a  narrow  beamwidth  in  azimuth  and  a  wide  one  in  elevation  allowing  for 
targets  that  are  accelerating  primarily  in  elevation.  These  azimuthal  and  elevational 
accelerations  are  with  respect  to  the  sensor’s  coordinate  space  which  is  assumed  to 
be  fixed  on  the  ground. 

There  are  two,  possibly  conflicting,  requirements  for  the  tracking  system.  First 
is  the  desire  to  have  target  state  information  with  as  high  a  precision  as  possible. 
Second  is  the  desire  to  never  lose  track  of  the  target,  since  this  would  send  the 
tracking  system  ,nto  a  time  consuming  search  mode  to  reacquire  the  target.  Filters 
one  and  three  provide  the  best  precision  estimates.  Filter  two  provides  the  least 
likelihood  of  losing  the  target.  Thus,  there  were  two  general  guidelines  for  developing 
the  rules.  First,  if  filters  one  or  three  are  doing  a  fairly  good  job  of  tracking  the  target, 
select  one  of  them.  Second,  if  the  target  has  apparently  done  some  type  of  maneuver 
and  the  system  is  not  quite  sure  which  filter  to  select,  select  filter  two. 

Some  of  the  KREST  rules  were  developed  to  overcome  one  of  the  inappropriate 
tendencies  of  the  MMAF.  This  tendency  is  to  stick  with  the  harshly-maneuvering 
filters  when  the  system  should  be  selecting  a  benign  filter.  As  Tobin  stated,  "...[the 
MMAF]  was  somewhat  more  hesitant  to  reduce  the  bandwidth  to  an  appropriate 
benign  level  when  the  target  comes  out  of  a  turn,  compared  to  the  speed  with  which 
it  opens  the  bandwidth  at  the  onset  of  a  pullup”  [21,  p.  19].  Thus,  to  compensate, 
many  of  the  KREST  rules  where  developed  to  favor  the  less-harsh  filters. 

4-5  Expert  system  (KREST)  overview. 

KREST  contains  both  LISP  functions  and  OPS-5  rules.  The  LISP  functions 
were  developed  to  determine  certain  state  characteristics.  The  OPS-5  rules  fall  into 
five  separate  tategories.  These  categories  are: 

1.  Initializing. 

2.  Updating. 

■  i.  Scheduling. 
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4.  Residual  Probability  Rules. 

5.  Printing. 

The  initializing  rule  defines  and  pre-sets  certain  variables  in  addition  to  reading 
in  header  information  from  the  data  file.  The  updating  rule  reads  in  the  next  set  of 
residual  probabilities.  The  scheduling  rules  are  needed  to  make  the  other  types  of 
rules  fire  in  the  proper  sequence.  The  residual  probability  rules  are  the  actual  expert 
rules  developed  from  discussions  with  Dr.  Maybeck.  The  final  version  of  KREST 
contained  just  ten  rules  related  specifically  to  selecting  filters.  The  printing  rule  is 
used  to  display  the  filter  selected  by  KREST  as  well  as  other  pertinent  information. 

The  filter  selection  done  by  KREST  is  sent  to  the  file  KRESTOut.  No  attempt 
has  been  made  to  have  KREST  run  concurrently  with  the  original  Kalman  filter 
simulation  software.  The  expert  filter  selection  is  done  on  a  post-processing  (also 
known  as  open  loop)  basis.  In  reality,  the  real-time  selection  of  the  "best’'  Kalman 
filter  does  have  an  effect  on  the  generation  of  filter  residuals.  As  such,  to  fully  test 
the  KREST  filter  selection  process  the  new  algorithm  would  need  to  be  included 
in  the  original  simulation  software.  Once  this  was  accomplished,  analysis  could  be 
performed  on  the  control  signal  being  developed  on  a  closed-loop  basis.  This  control 
signal  is  of  prime  importance  since  it  is  used,  theoretically,  to  point  the  IRST/Laser 
system.  One  of  the  best  ways  to  evaluate  the  performance  of  the  filter  selection 
expert  system  would  be  to  compare  the  control  signal  time  history  developed  from 
the  KREST- based  system  versus  the  control  signal  time  history  resulting  from  a 
MAP-based  system.  As  stated  previously,  no  attempt  was  made  to  incorporate  this 
closed-loop  feature  in  the  original  simulation  software. 

■{.(>  Ttsl  (  Vz.srs. 


The  rules  developed  for  KRES  I  came  from  t  he  residual  probalulit  v  graphs  from 
l  en  t  rajeetories.  I  rajertories  one  through  four  were  provided  in  t  he  original  soil  wave. 
I  i  a  jeetories  five  and  six  were  developed  to  stress  the  filter  selection  process.  While 
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trajectories  one  through  six  simulate  targets  moving  primarily  in  azimuth,  trajecto¬ 
ries  seven  and  eight  simulate  primarily  elevational  motion  and  trajectories  nine  and 
ten  simulate  a  diagonal  motion.  These  trajectories  are  described  in  Table  4.  Plots 
of  these  trajectories  are  included  in  Appendix  A.  The  purpose  of  these  trajectories 
is  not  to  simulate  specific  known  threats,  but  rather  to  exercise  the  filter  selection 
processes  (MAP  and  KREST)  under  diverse  conditions.  This  was  intended  so  that 
the  Kalman  filter  expert  would  develop  rules  that  applied  to  fairly  random  target 
trajectories. 


Table  4.  Target  Trajectory  Characteristics. 


Traj. 

Target 

Motion 

Loc.  at 
time=0.0 
(km) 

Vel.  at 
time=0.0 
(km/sec) 

Acc.  at 
time=2.0 
(G’s) 

Acc.  at 

time=3.5 

(G’s) 

1 

straight 

5.0  X 

-1.0  X 

0.0 

0.0 

0.5  Y 

0.0  Y 

2 _ 

circular 

5.0  X 

-1.0  X 

10.0 

10.0 

0.5  Y 

0.0  Y 

3 

circular 

5.0  X 

-1.0  X 

10.0 

0.0 

0.5  Y 

0.0  Y 

4 

circular 

5.0  X 

-1.0  X 

10.0 

10.0 

0.5  Y 

0.0  Y 

5 

circular 

5.0  X 

-1.0  X 

10.0 

-10.0 

0.5  Y 

0.0  Y 

6 

parabolic 

5.0  X 

-1.0  X 

20.4  X 

1.0  X 

0.5  Y 

0.0  Y 

20.4  Y 

-1.0  Y 

7 

parabolic 

0.5  X 

0.0  X 

-2.0  X 

0.0  X 

0.0  Y 

1.0  Y 

-2.0  Y 

0.0  Y 

8 

parabolic 

0.5  X 

0.0  X 

-2.0  X 

1.0  X 

0.0  Y 

1.0  Y 

0.0  Y 

0.5  Y 

9 

parabolic 

2.0  X 

-0.5  X 

-5.1  X 

-7.7  X 

0.0  Y 

0.5  Y 

5.1  5' 

0.0  5' 

10 

parabolic 

2.0  X 

-0.5  X 

10.2  X 

2.0  X 

0.0  Y 

0.5  5' 

1.0  Y 

2.0  5’ 

r> 
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V.  Results  and  Conclusions. 


5.1  KREST  Results. 

The  purpose  of  KREST  is  to  assist  in  the  MMAF  filter  selection  process.  The 
system  was  designed  to  be  especially  helpful  in  those  instances  when  the  MAP  se¬ 
lection  criteria  does  a  poor  job.  Some  of  these  situations  are  identified  in  Table  5. 

Table  5.  Problematic  Filter  Selection  Instances. 

1.  Transitions  from  the  high-g  filter  (No. 2)  to  the  benign  filter  (No.l). 

2.  Transitions  from  the  high-g  filter  (No. 2)  to  the  moderate-g  filter  (No. 3). 

3.  Transitions  between  the  X-oriented  (No. 4)  and  the  Y-oriented  (No. 5)  filters. 


The  expert  system  filter  selections  for  ten  target  trajectories  are  shown  in  Ap¬ 
pendix  E.  Portions  of  these  results  are  also  shown  in  Tables  7  through  15.  In  these 
tables:  Time  is  the  specific  time  interval:  Rule  is  the  number  of  the  KREST  rule 
that  fired,  if  any;  KF  is  the  filter  KREST  selected:  MAP  is  the  filter  selected  by 
the  maximum  a  posteriori  selection  process  (the  filter  with  largest  residual  proba¬ 
bility);  and  Pi  through  P5  are  the  residual  probabilities  of  filters  one  through  five, 
respectively. 

It  should  be  noted  that  trajectories  one  through  four  were  not  modified  from 
those  used  in  previous  research  [21]  [9],  Trajectories  five  through  ten  were  developed 
with  harsh-g  maneuvers  to  cause  the  MAP-based  system  to  select  the  "wrong"  filter. 

KREST  filter  selections  differ  from  those  chosen  by  the  MAP  selection  crite¬ 
ria  when  the  original  system  lingers  on  overly  dynamic  filters  and  during  transition 
periods  between  filters.  By  tending  towards  the  less  dynamic,  narrower  field  of  view 
(FOV)  filters.  KREST  has  helped  overcome  the  natural  tendency  of  the  MMAF 
system  to  stick  on  high-g  filters.  By  selecting  square  EON'  filters  when  the  perpen¬ 
dicularly  oriented  filters  have  significant  residual  probabilities.  KREST  also  prov  ide' 
a  means  of  smoothing  the  filter  selection  sequence,  l  or  example,  this  mav  result  in 


the  selection  of  a  square  filter  after  an  X-oriented  filter  and  just  before  a  Y-oriented 
filter,  providing  a  smoother  transition. 

5.1.1  Propensity  toward  benign  filters.  Rules  30  and  55  (Table  6)  are  exam¬ 
ples  of  KREST  rules  developed  to  compensate  for  the  original  system’s  tendency  to 
adhere  to  non-benign  filters.  These  rules  select  filter  three  when  the  residual  prob¬ 
abilities  of  filters  two  and  three  met  certain  constraints.  (Note:  The  precondition 
Best=2  in  Rule  50  is  satisfied  when  the  residual  probability  of  filter  two  is  larger 
than  all  others.  The  precondition  Best=3  for  last  3  or  more  in  Rule  30  is  satisfied 
when  KREST  has  selected  filter  three  during  the  previous  three  time  intervals.)  Ta¬ 
ble  7  demonstrates  that  these  rules  make  the  system  tend  toward  the  narrower  FOX' 
filters.  While  the  original  system  occasionally  selects  filter  two  following  time  119. 
KREST  sticks  with  filter  three  based  upon  the  significant  residual  probability  of  that 
filter.  Balanced  with  the  desire  for  improved  tracking  resolution  is  the  need  to  keep 
track  of  the  target.  Thus,  while  this  type  of  rule  "encourages"  the  use  of  narrow 
FOV  filters,  it  do  not  overly  restrict  the  system  when  the  use  of  a  wider  FOX  filter 
is  indicated.  The  thresholds  were  set  in  Rules  30  and  55  to  achieve  this  balance. 


Table  6.  KREST  Rules  30  and  55. 


Rule 

Precondition 

Filter 

30 

If  Best =3  for  last  3  or  more  and 
the  new  Best  =2  and 

P2  <0.7  and 

P3  >  0.2 

3 

55 

If  Best  =  2  and 

P3  >  0.25 

3 

Table  7.  KREST  Results  for  a  Portion  of  Trajectory  Two. 


Time  Rule 

Tie 


KF  MAP 
1  1 


i  .  * _ » _  r.  r, 


pi 

0.781 

0.721 

0.213 

0.243 

0.165 

0.057 

0.045 

0.193 

0.190 

0.098 

0.052 

0.086 

0.018 

0.006 

0.006 

0.003 

0.001 

0.002 

0.001 

0.001 

0.001 

0.001 

0.001 

0.001 

0.001 

0.001 

0.001 

0.002 

0.001 

0.001 


0.001 

0.001 

0.001 

0.001 

0.002 


P2 

0.101 
0.123 
0.580 
0.522 
0.438 
0.524 
0.499 
0.066 
0.046 
0.067 
0.063 
0.106 
0.270 
0.399 
0.365 
0.470 
0.575 
0.263 
0.250 
0.213 
0.241 
0.190 
0.173 
0.383 
0.467 
0.651 
0.516 
0.519 
0.158 
0.  163 
0.127 
0. 105 
0.529 
0. 160 
0.061 
0.(137 


P3 

0.092 
0.126 
0.179 
0.211 
0.370 
0.408 
0.446 
0.712 
0.737 
0.815 
0.867 
0.783 
0.695 
0.582 
0.620 
0.520 
0.419 
0.730 
0.748 
0.784 
0.755 
0.807 
0.824 
0.613 
0.530 
0.346 
0. 150 
0. 177 
0.538 
0.533 
0.570 
0.592 


P4 

0.001 
0.001 
0.004 
0.004 
0.003 
0.002 
0.002 
0.008 
0.007 
0.014 
0.015 
0.018 
0.014 
0.008 
0.007 
0.006 
0.001 
0  003 
0.001 
0.001 
0.001 
0.001 
0.001 
0.001 
0.001 
0.002 
0.001 
0.001 
0.001 
0.001 
0.001 
0.001 
0.001 
0.001 
0.002 
(1.00  I 


P5 

0.025 

0.029 

0.025 

0.021 

0.024 

0.009 

0.007 

0.021 

0.019 

0.006 

0.004 

0.007 

0.003 

0.004 

0.002 

0.002 

0.004 

0.002 

0.001 

0.001 

0.001 

0.001 

0.001 


Rule  40  (see  Table  8)  was  also  developed  to  give  KREST  a  propensity  toward 
the  more-benign  filters.  In  this  case,  the  desire  is  to  select  the  non-maneuver  filter 
(number  one)  over  the  moderate  maneuver  filter  (number  three).  Table  9  shows 
several  occasions  where  KREST  used  this  rule  to  determine  that  filter  one  had  a 
sufficient  residual  probability  level  to  warrant  its  selection.  While  these  selections 
may  not  result  in  a  startling  increase  in  performance,  some  improvement  is  expected. 
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Rule 

Precondition 

40 

If  Bcst=3  and 

PI  >  ( P3  *  0.5)  and 
PI  is  increasing. 

0. 

311 

0.003 

0. 

155 

0. 

337 

0. 

302 

0. 

320 

0. 

370 

0. 

372 

0. 

302 

0. 

378 

0. 

210 

0. 

412 

0. 

318 

o. 

370 

0. 

381 

0. 

171 

0. 

5 1  2 

0.012 

O.OOO 

0.002 

0.002 

0.001 

0.001 

0.001 

0.005 

0.001 

0.003 

o.oo.i 

0.001 

o.ooi 


0.512 
0. 1ST 
0.570 
0.  t!)<8 
0.152 
0.108 
0. 181 
0.08  | 
0.510 
0. 102 
0.  18  1 
0.175 

o. :{(>(> 


0.000  0.0.50 

0.058  0.057 

0.0  to  0.000 
o.o:i8  o.oo2 
0.02G  0.118 

0.018  0.121 
O.OM  0.120 
0.008  0.00(1 
0.001  0.071 

0.001  0.18- 
o.ooi  ii. i  i:i 
0.001  0.111 
0.001  0.101 


a Sai 
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5.1.2  Smoother  filter  transitions.  The  purpose  of  KREST  Rules  25.  70.  and 
75  (see  Table  10)  was  to  provide  for  smoother  transitions  between  the  orthogonal 
filters  four  (X-oriented)  and  five  ( Y-oriented).  The  expert  has  determined  that  if 
both  of  these  filters  have  significant  residual  probability  values,  that  the  best  choice 
would  be  one  of  the  square  FOV  filters.  Specifically,  the  system  should  select  either 
filter  one  with  its  narrow,  square  FOV  or  filter  two  with  its  large,  square  FOV. 
Rules  70  and  75  were  developed  with  similar  preconditions,  the  difference  being  that 
Rule  70  selects  filter  one  and  Rule  75  selects  filter  two.  The  filter  with  the  higher 
residual  probability  determines  which  rule  fires.  An  example  of  KREST's  use  of  this 
type  of  rule  is  shown  in  Table  11.  Whereas  the  original  system  transitioned  directly 
from  filter  five  to  filter  four  at  time  162  and  back  to  filter  five  at  time  165.  KREST 
provided  a  smoother  transition  by  using  filter  one. 

Originally,  no  minimum  thresholds  were  set  for  the  selected  filter.  As  a  result. 
Rule  70  fired  during  the  time  interval  of  152  to  155  in  Table  11.  These  times  are 
indicated  by  a  dash  in  the  Rule  column.  Dr.  Mavbeck  observed  that  since  neither 
filter  one  nor  two  had  a  residual  probability  above  0.07.  neither  should  be  selected. 
A  better  solution  would  be  to  let  filters  four  and  five  "fight  it  out."  The  threshold 
values  of  the  selected  filters  in  Rules  70  and  75  were  then  set  at  0.1  resulting  in  the 
desired  rule  firings  between  times  160  and  170. 


Table  12  also  shows  a  transition  between  filters  four  arul  five.  Dr.  Mavbei  k 
concluded  that  the  filter  selection  done  by  KREST  at  times  65  and  66.  that  of 
selecting  a  broad  FOX’  filter  (No. 2).  provided  a  nice  transition  between  these  filters. 

Table  12  also  shows  a  transition  from  the  wide  FOX  filter  l  No. 2)  and  the  nar¬ 
row  FOX’  filter  (No.l).  This  transition  occurs  between  times  82  and  117.  The  original 
selection  process  transitions  through  the  X-oriented  filter  (No. 4).  Dr.  Maybeck  con¬ 
cluded  that  since  filter  one  had  a  significant  residual  probability  well  before  time 
1)5.  that  filter  should  be  selected  earlier.  The  KREST  selected  filters  were  deemed 
appropriate  by  the  expert. 


Table  12.  KREST  Results  for  a  Portion  of  Trajectory  Five. 
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ime 

Rule 

KF 

MAP 

PI 

P2 

P3 

P4 

P5 

62 

4 

4 

0.018 

0.001 

0.001 

0.979 

0.001 

63 

4 

4 

0.037 

0.001 

0.003 

0.956 

0.002 

54 

4 

4 

0.033 

0.025 

0.015 

0.869 

0.058 

55 

75 

2 

4 

0.019 

0.160 

0.063 

0.446 

0.312 

66 

75 

2 

5 

0.001 

0.411 

0.001 

0.001 

0,586 

57 

5 

5 

0.001 

0.337 

0.003 

0.001 

0.657 

68 

5 

5 

0.001 

0.325 

0.001 

0.001 

0.672 

6!) 

•> 

2 

0.001 

0.561 

0.001 

0.001 

0.436 

70 

2 

2 

0.001 

0.519 

0.001 

0.001 

0,178 

S2 

2 

2 

0.024 

0.894 

0.018 

0.035 

0.029 

83 

2 

o 

0.019 

0.900 

0.01  1 

0.041 

0.026 

84 

2 

2 

0.100 

0.532 

0.079 

0.206 

0.082 

85 

1 5 

2 

4 

0.145 

0.307 

0.133 

0.102 

0.013 

86 

70 

1 

1 

0.187 

0.164 

0.180 

0.461 

0.008 

87 

70 

1 

4 

0.238 

0.017 

0.175 

0.568 

0.002 

88 

4 

4 

0.212 

0.040 

0.088 

0.656 

0.005 

89 

25 

1 

4 

0.332 

0.035 

0.139 

0.492 

0.004 

90 

25 

1 

4 

0.350 

0.045 

0.1 17 

0.484 

0.005 

91 

25 

1 

4 

0.370 

0.056 

0.099 

0.468 

0.007 

92 

25 

1 

4 

0.395 

0.049 

0.102 

0.449 

0.005 

93 

25 

1 

4 

0.399 

0.045 

0.097 

0.453 

0.005 

94 

25 

l 

4 

0. 131 

0.005 

0.069 

0,194 

0.001 

93 

1 

1 

0.634 

0.001 

0.081 

0.283 

0.001 

96 

1 

1 

0.771 

0.001 

0.049 

0.177 

11.00] 

97 

1 

1 

0.839 

0.001 

0.040 

0.1  18 

0.002 

98 

1 

1 

0.856 

0.001 

0.033 

0.108 

0.002 

99 

1 

1 

0.909 

0  001 

0.033 

0.056 

0.001 

The  purpose  of  trajectory  six  was  to  force  the  simulated  target  into  a  diagonal 
motion  in  an  attempt  to  make  the  original  system  alternate  between  the  X-oriented 
(No. 4)  and  the  Y-oriented  (No. 5)  filters  The  residual  probabilities  from  trajectory 
six  are  graphically  shown  in  Figure  11.  Due  to  the  kinematics  of  the  trajectory, 
the  system  has  difficulty  selecting  filters  between  times  1  S3  and  ‘JOS  isee  I  aide  l-'i  i. 
For  example,  at  time  184  filters  one.  two.  and  five  have  residual  probabilities  ,,f 
approximately  0.2G,  0.21,  and  0.29,  respectively.  At  time  188.  filters  one.  four,  and 
five  have  residual  probabilities  of  approximately  0.21.  0.29.  and  0.90.  respectively. 
Any  filter  selection  based  solely  upon  the  maximum  of  these  close  values  would  be 
more  chance  than  anything  else.  Rules  70  and  75  again  provide  a  mechanism  for 
smoothing  the  transition  between  filters  two  and  one  while  ail< aving  < >t her  lilt ei  s  with 
significant  residual  probabilities  ( e . g . .  filter  five  between  ! ' ' 2  and  195)  to  be  selected 
when  appropriate. 
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Table  13.  KREST  Results  for  a  Portion  of  Trajectory  Six. 


Time 

Rule 

KF 

MAP 

PI 

P2 

P3 

P4 

P5 

180 

2 

2 

0.131 

0.385 

0.085 

0.177 

0.222 

181 

2 

2 

0.151 

0.382 

0.094 

0.183 

0.190 

182 

2 

2 

0.190 

0.358 

0.068 

0.175 

0.210 

183 

75 

9 

5 

0.212 

0.268 

0.067 

0.167 

0.287 

184 

70 

i 

5 

0.255 

0.214 

0.064 

0.174 

0.293 

185 

75 

2 

5 

0.159 

0.222 

0.054 

0.166 

0.399 

186 

75 

2 

5 

0.133 

0.276 

0.032 

0.248 

0.311 

187 

75 

2 

5 

0.177 

0.235 

0.033 

0.237 

0.318 

188 

70 

1 

5 

0.213 

0.167 

0.041 

0.276 

0.303 

189 

75 

2 

4 

0.085 

0.206 

0.026 

0.545 

0.139 

190 

70 

1 

4 

0.130 

0.120 

0.025 

0.538 

0.186 

191 

70 

1 

5 

0.127 

0.062 

0.015 

0.349 

0.447 

192 

5 

5 

0.052 

0.086 

0.015 

0.103 

0.743 

193 

5 

5 

0.052 

0.138 

0.020 

0.130 

0.661 

194 

5 

5 

0.058 

0.092 

0.020 

0.143 

0.688 

195 

5 

5 

0.080 

0.096 

0.023 

0.121 

0.680 

196 

70 

1 

5 

0.115 

0.081 

0.028 

0.272 

0.504 

197 

70 

1 

5 

0.199 

0.086 

0.031 

0.198 

0.187 

198 

70 

1 

5 

0.213 

0.035 

0.028 

0.196 

0.199 

199 

70 

1 

5 

0.293 

0.032 

0.029 

0.210 

0.436 

200 

1 

1 

0.351 

0.042 

0.019 

0.246 

0.342 

201 

70 

1 

5 

0.345 

0.031 

0.019 

0.248 

0.358 

202 

1 

i 

0.389 

0.024 

0.018 

0.243 

0.326 

203 

1 

i 

0.468 

0.020 

0.018 

0.161 

0.333 

204 

1 

i 

0.546 

0.019 

0.020 

0.176 

0.239 

205 

1 

i 

0.570 

0.018 

0.015 

0.168 

0.228 

206 

70 

1 

4 

0.337 

0.049 

0.024 

0.537 

0.052 

207 

25 

1 

4 

0.389 

0.017 

0.019 

0.512 

0.062 

208 

1 

1 

0.487 

0.014 

0.018 

0.412 

0.070 

209 

1 

1 

0.707 

0.016 

0.017 

0.195 

0.066 

_ _ 

1 

1 

0.739 

0.011 

0.015 

0.181 

0.053 

basically  horizontally  moving  target,  trajectories  seven  and  eight  simulated  primarily 
vertical  motions  and  trajectories  nine  and  ten  tested  primarily  diagonal  motions. 
Analysis  of  the  KREST  results  for  these  new  trajectories  showed  that  the  current 
rules  were  adequate.  No  new  rules  could  be  developed  from  the  results  and  all  rules 
that  did  fire  were  deemed  appropriate  by  the  expert. 

Trajectories  seven  through  ten  did,  however,  prompt  one  change  to  the  rule- 
base.  Early  discussions  with  the  expert  led  to  the  development  of  several  rules 
that  attempted  to  catch  transitions  between  the  X-direction  filter  (No. 4)  and  the 
Y-direction  filter  (No. 5).  These  rules  are  shown  in  Table  14.  The  general  idea  was  to 
find  instances  where  the  MAP  selection  criteria  had  selected  one  of  these  filters  for 
several  time  periods  and  then  attempted  to  transition  directly  to  the  other,  orthog¬ 
onal  filter.  If  this  was  attempted  while  the  wide  FOV  filter  (No.2)  had  a  significant 
residual  probability,  then  the  expert  wanted  to  select  that  wide  FOX’  filter.  Three 
rules  were  developed,  one  checking  for  transitions  from  filter  four  to  filter  five  (Rule 
10).  another  checking  for  transitions  from  filter  five  to  filter  four  (Rule  15).  and  a 
third  checking  for  a  history  of  alternating  between  filters  four  and  five  (Rule  20). 
Originally,  these  rules  would  occasionally  fire.  However,  as  faster  rules  were  devel¬ 
oped  (those  that  did  not  require  a  history  of  certain  filters  being  selected)  these 
historical  rules  no  longer  applied.  As  an  example.  Table  12  shows  a  transition  be¬ 
tween  filters  four  and  five  at  time  interval  65.  The  first  of  these  historical  rules 
checked  for  a  series  of  selecting  filter  four  before  going  to  filter  five.  This  condition 
would  have  occurred  at  time  66.  except  for  the  fact  that  Rule  75  has  fired  at  time  65 
selecting  filter  two.  This  defeats  the  precondition  of  the  historical  rule  and  precludes 
it  from  firing.  Trajectories  seven  through  ten  confirmed  that,  at  least  for  those  cases, 
the  historical  rules  had  been  superseded  by  some  of  the  later  rules.  Thus.  Rules  in. 
15.  and  20  were  deleted. 
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As  with  any  expert  system,  any  rule  that  has  its  precondition  satisfied  can  fire. 
Thus,  while  the  “Rule’’  column  of  the  KREST  results  shows  the  one  rule  that  fired, 
more  than  one  rule  may  have  had  its  preconditions  met.  While  reviewing  the  results, 
if  more  than  one  rule  applied,  each  applicable  rule  was  checked  to  make  sure  there 
were  no  conflicts.  "No  conflicts”  means  that  all  of  the  rules  that  applied  would  have 
selected  the  same  filter.  In  two  cases  there  were  conflicts.  These  conflicts  occurred 
in  trajectory  six  at  time  183  (see  Table  13)  and  in  trajectory  10  at  time  d(i  isce 
Table  15).  In  these  cases  Rules  60  and  61  attempted  to  select  the  narrow  FOX’  filter 
(Xo.l)  while  Rule  75  attempted  to  select  the  wide  FOX"  filter  (No. 2).  The  original 
purpose  behind  Rules  60  and  61  was  to  select  filter  one  if  it  had  a  sufficient  residual 
probability  while  the  filter  with  the  highest  probability  had  a  residual  probability  less 
than  a  certain  threshold  (see  Table  16).  Thus,  if  there  was  “confusion"  over  which 
filter  to  go  with  (since  all  filters  had  residual  probability  values  below  a  certain  level  ) 
the  system  would  tend  to  go  with  filter  one.  Rules  70  and  75  were  developed  later 
on.  Fhe  intent  of  these  rules  was  to  look  for  conflicts  between  the  X-oriented  \  No.  Fi 
and  Y-oriented  (No. 5)  filters.  When  the  specific  preconditions  were  met.  these  rules 
selected  either  the  narrow  FOX'  filter  (No.l )  or  the  wide  FOX’  (No. 2)  filter,  depending 
upon  which  had  the  larger  residual  probability. 


Table  15.  KREST  Results  for  a  Portion  of  Trajectory  Ten. 


Time 

Rule 

KF 

MAP 

Pi 

P2 

P3 

P4 

P5 

92 

2 

2 

0.053 

0.833 

0.016 

0.049 

0.048 

93 

2 

2 

0.067 

0.813 

0.019 

0.051 

0.051 

94 

2 

2 

0.071 

0.386 

0.020 

0.370 

0.154 

95 

1 5 

2 

4 

0.113 

0.248 

0.027 

0.467 

0.145 

96 

75 

2 

4 

0.202 

0.243 

0.045 

0.330 

0.180 

97 

70 

1 

4 

0.258 

0.211 

0.051 

0.278 

0.202 

98 

1 

1 

0.333 

0.156 

0.054 

0.263 

0.193 

99 

1 

1 

0.382 

0.170 

0.053 

0.207 

0.188 

100 

1 

1 

0.475 

0.093 

0.056 

0.210 

0.165 
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Table  16.  KREST  Rules  60  and  61. 


Rule 

Precondition 

Selected 

Filter 

60 

If  PBest  <  0.4  and 

Pi  >0.2  and 

Pi  is  increasing  and 
Best  <>  Filter  1 

1 

61 

If  PBest  <  0.4  and 

Pi  >  0.2  and 

Best  <>  Filter  1 

1 

Dr.  Maybeck  reviewed  the  filter  selection  process  where  these  anomalies  oc¬ 
curred.  In  both  situations,  the  original  MAP  selection  process  was  transitioning 
from  filter  two  to  filter  one.  (Although  in  trajectory  six.  this  transition  took  approx¬ 
imately  twenty  time  intervals  to  complete.)  In  these  cases  it  was  not  clear  whether 
filter  one  or  two  was  the  better  choice.  As  such,  the  expert  decided  to  go  with  Rules 
70  and  75  which  allow  filters  one  and  two  to  “fight  it  out."  Since  Rules  60  and  61 
could  be  removed  with  no  effect  on  KREST's  performance  (other  than  at  these  two 
anomalistic  occurrences),  the  rules  were  deleted. 

5.J  ('onclutions. 

By  analyzing  the  residual  probability  graphs  of  the  five  filters  (see  Appendix 
D).  the  expert  (Dr.  Maybeck)  was  aide  to  express  rules  that  selected  the  filters 
he  desired.  The  resulting  expert  system.  KREST.  provided  an  improvement  over 
the  original  MAP  selection  process.  Although  no  quantitative  estimate  of  improve¬ 
ment  is  available.  Dr.  Maybeck  stated  that  KREST  exhibited  a  “.  . .  potentially  very 
significant  performance  improvement  over  the  Bayesian  and  MAP  filter  'ele<in>it 
techniques"  [13j. 

This  research  has  laid  the  foundation  lor  the  real  question  that  need>  in  v 
asked:  ''('an  advanced  Kalman  filter  svstems  be  used  to  facilitate  senior  In.- ion.’ 


61 


While  KREST  was  not  intended  to  answer  that  question  directly,  its  perfor¬ 
mance  indicates  that  expert  knowledge  can  be  used  to  improve  the  selection  process 
of  discrete  filter  models.  In  this  research  the  filters  have  modeled  different  assump¬ 
tions  about  the  target's  trajectory  (e.g.,  filter  one  models  a  benign  target  while  filter 
two  models  a  high-g,  maneuvering  target).  The  filters  could  be  changed  to  model 
assumptions  about  how  sensor  data  from  separate  sources  could  be  combined  or  con¬ 
trasted.  A  KREST-like  program  could  then  be  developed  to  select  “sensor  fusion" 
Kalman  filters.  The  encouraging  performance  of  KREST  indicates  that  advanced 
MMAF  systems  infused  with  some  type  of  expert  knowledge,  may  help  lesson  the 
problems  associated  with  sensor  data  fusion. 

5.3  Recommendations. 

There  are  several  ways  this  research  could  be  extended.  These  range  from 
embedding  the  rules  from  the  expert  system  into  the  original  simulation  software  to 
making  changes  to  the  multiple  model  adaptive  filters  themselves. 

Although  the  expert  system  shell  (OPS-o)  provided  a  flexible  environment  for 
testing  and  refining  rules,  the  final  version  of  the  expert  system  required  only  ten 
domain-specific  rules.  As  such,  the  current  rulebase  could  easily  be  converted  to  a 
sequential  computer  language  (e.g..  FORTRAN)  for  inclusion  in  the  MMAF  Emula¬ 
tion  program.  This  is  necessary  for  the  system  to  be  fully  tested.  Currently.  KRES  I 
makes  decisions  on  an  open- loop  basis.  This  means  that  KREST  has  no  effect  on 
the  generation  of  the  filter  residual  probabilities.  By  closing  the  loop  fi.e..  havimi 
KREST  make  selections  as  the  MMAF  simulation  program  runs  through  its  Monte 
Carlo  analysis)  a  numeric  evaluation  of  KRES  I  could  be  performed.  Currently,  tin- 
expert  svstem  is  evaluated  subjectively  bv  the  expert.  Since  the  location  ot  the 
simulated  target  and  the  estimates  of  each  filter  can  be  obtained,  the  boM  filler  .it 
each  t  ime  interval  could  be  m lent  died  I  his  would  I  hen  provide  a  numern  ev.du.ii  :<  a, 
of  the  expert  -VMeinC  performance.  Once  the  numeric, dlv  hern  tiller'  lia'.e  Set-:: 


determined,  this  knowledge  could  be  used  by  the  expert  to  modify  KREST’s  rules. 

Some  type  of  explanation  system  should  be  developed  so  that  KREST  can 
provide  the  person  tuning  the  filters  with  some  type  of  rationale  as  to  why  certain 
filters  are  being  selected.  This  would  be  important  since  the  filter  selection  process 
is  based  upon  both  the  expert  rules  and  the  filter  modeling. 

Software  should  be  developed  to  simulate  Kalman  filters  receiving  data  from 
more  than  one  sensor.  This  may  be  used  to  verify  the  usefulness  of  expert  system- 
based  MMAF  selection  as  a  solution  to  the  sensor  fusion  problem.  Rules  for  the 
expert  system  could  be  based  upon  knowledge  the  expert  has  concerning  specific 
sensor  strengths  and  weaknesses.  These  rules  might  also  consider  what  effect  sensor- 
degradation  has  on  the  resulting  estimates. 

Lastly,  the  use  of  an  expert  system  such  as  KREST  should  be  considered  for 
other  types  of  adaptive  estimation  and  control  tasks  to  further  investigate  the  results 
of  this  research. 
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Appendix  B.  Multiple  Kalman  Filter  Residual  Plots. 
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Appendix  C.  Kalman  Filter  Residual  Statistics  Plots  for  Trajectory 


Figure  29.  Mean  Statistic  of  Filter  Number  Three  Residuals 


from  Trajectory  Two. 
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!•  igure  31.  Mean  Statistic  of  Filter  Number  Five  Residuals 
from  Trajectory  Two 


figure  .!'J.  Slope  Statist  ie  of  filler  Number  One  KebduaF 
Rom  1  ra jeel  ory  Two. 


Figure  3‘J.  Percent  Mean  Crossing  Statistic  of  Filter  Number  Three  Ue>i<luals 

from  Trajectory  Two. 
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figure  41.  Percent  Mean  Crossing  Statistic  of  Filter  Number  Five  llesi<.lual.s 

from  Trajectory  'Two 


one  \2.  i’r<4).il>i!il  v  Oatissian  Stalislic  nl  Tiller  Number  One  Kemlu. 

I  n  'in  1 1  ,i  jei'i  i  n  v  I  tVi ) . 


W.v.v.v.v  v.v.v.  .y.'  c.  - 


Figure  '13.  Probability  Gaussian  Statistic  of  Filter  Number  Two  Residuals 

from  Trajectory  Two. 
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Appendix  D.  Kalman  Filter  Residual  Probabilities  Plots. 
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Appendix  E.  KREST  Results 
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KREST:  Kalman  filter  Expert  SysTem. 
NFRMS :  240 
ITraj:  1 


#  Rule 

KR 

MAP 

PI 

P2 

P3 

P4 

P5 

1 

1 

1 

0.9600 

0.0100 

0.0100 

0.0100 

0.0100 

2 

1 

1 

0.9600 

0.0100 

0.0100 

0.0100 

0.0100 

3 

1 

1 

0.9605 

0.0092 

0.0100 

0.0103 

0.0099 

4 

1 

1 

0.9644 

0.0014 

0.0091 

0.0178 

0.0073 

5 

1 

1 

0.9046 

0.0040 

0.0140 

0.0676 

0.0098 

6 

1 

1 

0.8829 

0.0051 

0.0122 

0.0900 

0.0099 

7 

1 

1 

0.8849 

0.0014 

0.0082 

0.0967 

0.0087 

8 

1 

1 

0.8909 

0.0013 

0.0079 

0.0918 

0.0081 

9 

1 

1 

0.9001 

0.0010 

0.0077 

0 . 0841 

0.0071 

10 

1 

1 

0.9025 

0.0013 

0.0068 

0.0812 

0.0082 

11 

1 

1 

0.8835 

0.0010 

0.0070 

0.1001 

0.0084 

12 

1 

1 

0 . 8835 

0.0010 

0.0059 

0.1036 

0.0060 

13 

1 

1 

0.8625 

0.0010 

0.0053 

0.1255 

0.0057 

14 

1 

1 

0 . 8797 

0.0010 

0 . 0040 

0.1121 

0.0032 

15 

1 

1 

0.8957 

0.0010 

0.0039 

0.0964 

0.0030 

16 

1 

1 

0 . 8840 

0.0010 

0.0038 

0.1083 

0.0029 

17 

1 

1 

0 . 8948 

0.0010 

0.0039 

0.0979 

0.0024 

18 

1 

1 

0.9270 

0.0010 

0.0039 

0.0672 

0.0010 

19 

1 

1 

0.8661 

o.ooio 

0.0025 

0.1294 

0.0010 

20 

1 

1 

0.9143 

0.0010 

0.0010 

0 . 0827 

0.0010 

21 

1 

1 

0.9020 

0.0010 

0.0010 

0.0949 

0.0011 

22 

1 

1 

0.9586 

0.0010 

0.0012 

0.0383 

0.0010 

23 

1 

1 

0.9668 

0.0010 

0.0010 

0.0302 

0.0010 

24 

1 

1 

0.9636 

0.0010 

0.0010 

0 . 0334 

0.0010 

25 

1 

1 

0.9634 

0.0010 

0.0010 

0.0336 

0.0010 

26 

1 

1 

0 . 7833 

0.0010 

0.0010 

0.2137 

0.0010 

27 

1 

1 

0.7072 

0.0010 

0.0010 

0.2898 

0.0010 

28 

1 

1 

0.8328 

0.0017 

0.0010 

0.1635 

0.0010 

29 

1 

1 

0.8499 

0.0010 

0.0010 

0.1471 

0.0010 

30 

1 

1 

0.8297 

0.0010 

0.0010 

0.1673 

0.0010 

31 

1 

1 

0.7769 

0.0010 

0.0010 

0.2201 

0.0010 

32 

1 

1 

0.7838 

0.0010 

0.0010 

0.2132 

0.0010 

33 

1 

1 

0.7676 

0.0010 

0.0010 

0.2294 

0.0010 

34 

1 

1 

0.7818 

0.0010 

C.0010 

0.2152 

0.0010 

35  65 

1 

4 

0.3677 

0.0010 

0.0010 

0.6293 

0.0010 

1 


0.2524 

0.0010 

0.0010 

0.7446 

0.0010 

0 . 0835 

0.0021 

0.0010 

0.9124 

0.0010 

0.0918 

0.0018 

0.0012 

0 . 9043 

0.0010 

0.0903 

0.0016 

0.0012 

0.9059 

0.0010 

0.1073 

0.0010 

0.0010 

0.8896 

0.0010 

0 . 1377 

0.0010 

0.0010 

0.8592 

0.0011 

0 . 0449 

0.0010 

0.0010 

0.9521 

0.0010 

0.0366 

0.0010 

0.0010 

0.9604 

0.0010 

0 . 0422 

0.0011 

0.0010 

0.9544 

0.0012 

0.0261 

0.0010 

0.0013 

0.9707 

0.0010 

0.0267 

0.0010 

0.0010 

0.9703 

0.0010 

0.0325 

0.0014 

0.0014 

0.9637 

0.0010 

0.0286 

0.0010 

0.0010 

0.9684 

0.0010 

0 . 0345 

0.0011 

0.0015 

0.9616 

0.0014 

0 . 0040 

0.0010 

0.0010 

0.9930 

0.0010 

0 . 0037 

0.0010 

0.0011 

0.9932 

0.0010 

0.0052 

0.0010 

0.0010 

0.9918 

0.0010 

0.0114 

0.0018 

0.0010 

0 . 9842 

0.0016 

0.0242 

0.0026 

0.0016 

0 . 9687 

0.0029 

0.0343 

0.0026 

0.0021 

0.9585 

0.0025 

0.0365 

0 . 0040 

0.0035 

0.9515 

0 . 0044 

0.0411 

0.0036 

0.0035 

0.9496 

0.0022 

0.0393 

0 . 0038 

0 . 0046 

0 . 9498 

0.0025 

0.0276 

0.0010 

0.0019 

0.9682 

0.0013 

0.0086 

0.0010 

0.0010 

0 . 9884 

0.0010 

0.0174 

0.0010 

0.0018 

0.9785 

0.0012 

0.0186 

0.0010 

0.0010 

0.9784 

0.0010 

0.0264 

0.0010 

0.0015 

0.9690 

0.0021 

0.0245 

0.0012 

0.0015 

0.9703 

0.0025 

0.0192 

0.0010 

0.0010 

0 . 9778 

0.0010 

0.0232 

0.0017 

0.0029 

0.9706 

0.0016 

0.0296 

0.0010 

0.0028 

0.9656 

0.0010 

0.0299 

0.0010 

0.0024 

0.9657 

0.0010 

0.0427 

0.0010 

0.0034 

0.9516 

0.0013 

0.0367 

0.0010 

0.0028 

0.9585 

0.0010 

0.0699 

0.0014 

0.0038 

0.9232 

0.0017 

0.0737 

0.0010 

0.0027 

0.9215 

0.0011 

0.0622 

0.0010 

0.0012 

0.9346 

0.0010 

0.0493 

0.0010 

0.0010 

0.9477 

0.0010 

0.0600 

0.0010 

O.OOiO 

0.9369 

0.0011 

0.1062 

0,0013 

0.0016 

0.8897 

0.0012 
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77 

4 

4 

0.1112 

0.0010 

0.0013 

0.8854 

0.0010  1 

78 

4 

4 

0.1069 

0.0010 

0.0010 

0.8898 

o.ooi3  ajj 

0.0014  Wa 

79 

4 

4 

0.1078 

0.0010 

0.0010 

0.8887 

80 

4 

4 

0.1233 

0.0010 

0.0010 

0.8737 

0.0010  JVMV 

81 

4 

4 

0.1323 

0.0012 

0.0012 

0.8637 

0.0016  Jgti 

82 

4 

4 

0 . 1498 

0.0010 

0.0010 

0.8472 

o.ooio  JL. 

83 

4 

4 

0.1013 

0.0010 

0.0010 

0.8957 

0.0010  vW 

84 

4 

4 

0.1300 

0.0012 

0.0015 

0.8663 

0.0011 

85 

4 

4 

0 . 0400 

0.0012 

0.0012 

0.9566 

o.ooio 

86 

4 

4 

0.0624 

0.0056 

0.0024 

0.9286 

0.0010  jjffi 

87 

4 

4 

0 . 0483 

0.0036 

0.0017 

0 . 9454 

0.0010  ^ 

88 

4 

4 

0.0397 

0.0010 

0.0010 

0.9573 

o.ooio  DJKJ 

89 

4 

4 

0.0660 

0.0015 

0.0011 

0.9303 

0.0010  2$ 

90 

4 

4 

0.0695 

0.0010 

0.0010 

0.9275 

o.ooio 

91 

4 

4 

0.0841 

0.0012 

0.0010 

0.9124 

0.0013  M& 

0.0010  " 

92 

4 

4 

0.0978 

0.0010 

0.0010 

0.8992 

93 

4 

4 

0.0981 

0.0010 

0.0010 

0.8989 

0.0010 

0.0031 

94 

25  1 

4 

0.4188 

0.0110 

0.0030 

0.5639 

95 

1 

1 

0.7485 

0 . 0049 

0.0032 

0 . 2402 

96 

1 

1 

0.8259 

0.0010 

0.0013 

0.1682 

0.0037  $5 

97 

1 

1 

0.8690 

0.0010 

0.0010 

0.1261 

0.0029 

98 

1 

1 

0 . 8827 

0.0010 

0.0010 

0.1128 

0.0024 

99 

1 

1 

0.8794 

0.0010 

0.0010 

0.1166 

0 . 0020  SJs 

0 . 0020  W 

100 

1 

1 

0.8443 

0.0010 

0.0010 

0.1517 

101 

102 

1 

1 

1 

1 

0.8475 

0.8934 

0.0010 

0.0012 

0.0010 

0.0011 

0.1490 

0.1021 

0.0015  £>■ 

0.0021  few) 

103 

1 

1 

0.9181 

0.0020 

0.0065 

0.0719 

0.0014  Jf.- 

104 

1 

1 

0.9838 

0.0010 

0 . 0048 

0.0092 

0.0012 

105 

1 

1 

0.9876 

0.0010 

0.0041 

0.0063 

0.0011  ^ 

0.0011  ^ 

o.ooio 

106 

1 

1 

0.9891 

0.0010 

0.0027 

0.0062 

107 

1 

1 

0.9887 

0.0010 

0.0023 

0.0070 

108 

1 

1 

0.9894 

0.0010 

0.0017 

0.0069 

0.0010 

109 

1 

1 

0.9898 

0.0010 

0.0014 

0.0068 

o.ooio  X 

110 

1 

1 

0.9876 

0.0010 

0.0016 

0.0081 

0.0017  XX 

111 

1 

1 

0.9904 

0.0010 

0.0013 

0.0059 

0.0013  y-y‘ 

112 

1 

1 

0.9906 

0.0010 

0.0014 

0.0053 

o.ooi7 

113 

1 

1 

0.9816 

0.0018 

0.0027 

0.0124 

0.0015  »  ] 

114 

1 

1 

0.9861 

0.0011 

0.0022 

0.0093 

0.0013  ^ 

115 

1 

1 

0.9889 

0.0010 

0.0015 

0.0076 

o.oon 

116 

1 

1 

0.9866 

0.0010 

0.0011 

0.0103 

0.0010  */v’ 

117 

1 

1 

0.9862 

0.0010 

0.0010 

0.0107 

o.ooio 

• 
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0.9851 

0.0065 

0.0010 

0.0064 

0.0010 

0.9852 

0.0046 

0.0010 

0.0081 

0.0010 

0.9857 

0.0041 

0.0010 

0 . 0082 

0.0010 

0.8651 

0.0013 

0.0020 

0.1296 

0.0020 

0.9772 

0.0010 

0.0024 

0.0177 

0.0017 

0.9897 

0.0010 

0.0013 

0.0064 

0.0016 

0.9932 

0.0010 

0.0010 

0.0038 

0.0011 

0.9930 

0.0010 

0.0010 

0 . 0040 

0.0010 

0.9939 

0.0010 

0.0010 

0.0031 

0.0010 

0.9915 

0.0010 

0.0015 

0 . 0049 

0.0010 

0.9914 

0.0010 

0.0016 

0.0050 

0.0010 

0.9930 

0.0010 

0.0013 

0.0037 

0.0010 

0.9823 

0.0049 

0.0095 

0.0024 

0.0010 

0.9942 

0.0010 

0.0028 

0.0010 

0.0010 

0.9954 

0.0010 

0.0017 

0.0010 

0.0010 

0.9954 

0.0011 

0.0012 

0.0013 

0.0011 

0.9960 

0.0010 

0.0010 

0.0010 

0.0010 

0.9957 

0.0010 

0.0010 

0.0012 

0.0011 

0.9953 

0.0013 

0.0010 

0.0014 

0.0010 

0.9943 

0.0015 

0.0012 

0.0020 

0.0010 

0.9947 

0.0013 

0.0012 

0.0018 

0.0010 

0.9957 

0.0010 

0.0010 

0.0013 

0.0010 

0.9953 

0.0010 

0.0011 

0.0016 

0.0010 

0.9954 

0.0010 

0.0010 

0.0016 

0.0010 

0.9959 

0.0010 

0.0010 

0.0010 

0.0011 

0.9960 

0.0010 

0.0010 

0.0010 

0.0010 

0.9958 

0.0010 

0.0012 

0.0010 

0.0010 

0 . 9946 

0.0016 

0.0010 

0.0018 

0.0010 

0.9954 

0.0012 

0.0010 

0.0015 

0.0010 

0.9956 

0.0012 

0.0010 

0.0012 

0.0010 

0.9920 

0.0027 

0.0012 

0.0031 

0.0010 

0.9942 

0.0014 

0.0010 

0.0025 

0.0010 

0.9944 

0.0026 

0.0010 

0.0010 

0.0010 

0.9909 

0.0036 

0.0021 

0.0015 

0.0019 

0.9892 

0.0049 

0.0030 

0.0017 

0.0012 

0.9894 

0.0045 

0.0031 

0.0019 

0.0010 

0.9922 

0.0031 

0.0023 

0.0013 

0.0010 

0.9839 

0.0060 

0.0046 

0.0045 

0.0010 

0.9882 

0.0051 

0 . 0027 

0.0030 

0.0010 

0.9910 

0.0038 

0.0019 

0.0024 

0.0010 

0.9914 

0.0033 

0.0018 

0.0025 

0.0010 
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200 

1 

1 

0.9836 

0.0077 

0.0010 

0.0052 

0 . 0024 

201 

1 

1 

0.9882 

0.0050 

0.0010 

0 . 0046 

0.0012 

202 

1 

1 

0.9909 

0.0037 

0.0010 

0.0034 

0.0010 

203 

1 

1 

0.9920 

0.0030 

0.0010 

0.0030 

0.0010 

204 

1 

1 

0.9922 

0.0026 

0.0010 

0.0032 

0.0010 

205 

1 

1 

0.9931 

0.0016 

0.0010 

0.0033 

0.0010 

206 

1 

1 

0.9929 

0.0012 

0.0010 

0.0039 

0.0010 

207 

1 

1 

0.9932 

0.0012 

0.0010 

0 . 0035 

0.0011 

208 

1 

1 

0.9941 

0.0010 

0.0010 

0.0029 

0.0010 

209 

1 

1 

0.9941 

0.0016 

0.0011 

0.0021 

0.0011 

210 

1 

1 

0 . 9945 

0.0015 

0.0011 

0.0019 

0.0010 

211 

1 

1 

0.9936 

0.0013 

0.0011 

0.0030 

0.0010 

212 

1 

1 

0.9918 

0.0015 

0.0012 

0 . 0044 

0.0010 

213 

1 

1 

0.9918 

0.0015 

0.0012 

0 . 0044 

0.0011 

214 

1 

1 

0.9929 

0.0010 

0.0010 

0.0041 

0.0010 

215 

1 

1 

0.9909 

0.0019 

0.0016 

0 . 0045 

0.0011 

216 

1 

1 

0.9931 

0.0014 

0.0014 

0.0031 

0.0010 

217 

1 

1 

0.9934 

0.0012 

0.0011 

0 . 0032 

0.0011 

218 

1 

1 

0.9889 

0.0051 

0.0021 

0.0022 

0.0017 

219 

1 

1 

0.9923 

0.0037 

0.0010 

0.0020 

0.0010 

220 

1 

1 

0.9921 

0.0033 

0.0011 

0.0025 

0.0010 

221 

1 

1 

0.9906 

0.0041 

0.0010 

0.0033 

0.0010 

222 

1 

1 

0.9919 

0.0034 

0.0010 

0 . 0027 

0.0010 

223 

1 

1 

0.9897 

0.0050 

0.0015 

0.0028 

0.0010 

224 

1 

1 

0.9913 

0.0039 

0.0013 

0.0025 

0.0010 

225 

1 

1 

0.9908 

0.0040 

0.0013 

0.0029 

0.0010 

226 

1 

1 

0.9900 

0.0067 

0.0010 

0.0013 

0.0010 

227 

1 

1 

0.9904 

0.0062 

0.0010 

0.0013 

0.0011 

228 

1 

1 

0 . 9946 

0.0021 

0.0010 

0.0013 

0.0010 

229 

1 

1 

0.9950 

0.0017 

0.0010 

0.0013 

0.0010 

230 

1 

1 

0.8701 

0.1029 

0.0051 

0.0209 

0.0010 

231 

1 

1 

0.8832 

0.0910 

0.0058 

0.0190 

0.0010 

232 

1 

1 

0.9196 

0.0616 

0 . 0048 

0.0130 

0.0010 

233 

1 

1 

0.9117 

0.0643 

0.0025 

0.0201 

0.0014 

234 

1 

1 

0.9326 

0.0442 

0.0024 

0.0196 

0.0013 

235 

1 

1 

0.9389 

0.0386 

0.0019 

0.0196 

0.0010 

236 

1 

1 

0.9535 

0.0295 

0.0016 

0.0145 

0.0010 

237 

1 

1 

0.9500 

0.0319 

0.0018 

0.0152 

0.0010 

238 

1 

1 

0.9589 

0.0246 

0.0016 

0.0139 

0.0010 

239 

1 

1 

0.7330 

0 . 1092 

0.0045 

0.  1518 

0.0015 

240 

1 

1 

0.8111 

0 . 0434 

) . 0036 

0.1405 

0.0015 

^i: 

7iV,i 


■  •.  vvv-.v, y 


V  -•.V.V.v^VV^^ 


n 


i 


'V*' 


KREST :  Kalman  filter  Expert  SysTem. 
NFRMS :  240 
ITraj :  2 


*  Rule 

KR 

MAP 

PI 

P2 

P3 

P4 

P5 

1 

1 

1 

0.9600 

0.0100 

0.0100 

0.0100 

0.0100 

2 

1 

1 

0.9600 

0.0100 

0.0100 

0.0100 

0.0100 

3 

1 

1 

0.9605 

0.0092 

0.0100 

0.0103 

0.0099 

4 

1 

1 

0.9644 

0.0014 

0.0091 

0.0178 

0.0073 

5 

1 

1 

0 . 9046 

0.0040 

0.0140 

0.0676 

0.0098 

6 

1 

1 

0.8829 

0.0051 

0.0122 

0.0900 

0.0099 

7 

1 

1 

0.8849 

0.0014 

0.0082 

0.0967 

0.0087 

8 

1 

1 

0.8909 

0.0013 

0.0079 

0.0918 

0.0081 

9 

1 

1 

0.9001 

0.0010 

0.0077 

0.0841 

0.0071 

10 

1 

1 

0.9025 

0.0013 

0.0068 

0.0812 

0.0082 

11 

1 

1 

0.8835 

0.0010 

0.0070 

0.1001 

0.0084 

12 

1 

1 

0.8835 

0.0010 

0.0059 

0.1036 

0.0060 

13 

1 

1 

0.8625 

0.0010 

0.0053 

0.1255 

0.0057 

14 

1 

1 

0.8797 

0.0010 

0.0040 

0.1121 

0.0032 

15 

1 

1 

0.8957 

0.0010 

0.0039 

0.0964 

0.0030 

16 

1 

1 

0.8840 

0.0010 

0.0038 

0.1083 

0.0029 

17 

1 

1 

0 . 8948 

0.0010 

0.0039 

0.0979 

0.0024 

18 

1 

1 

0.9270 

0.0010 

0.0039 

0.0672 

0.0010 

19 

1 

1 

0.8661 

0.0010 

0.0025 

0.1294 

0.0010 

20 

1 

1 

0.9143 

0.0010 

0.0010 

0.0827 

0.0010 

21 

1 

1 

0.9020 

0.0010 

0.0010 

0.0949 

0.0011 

22 

1 

1 

0.9586 

0.0010 

0.0012 

0 . 0383 

0.0010 

23 

1 

1 

0.9668 

0.0010 

0.0010 

0.0302 

0.0010 

24 

1 

1 

0.9636 

0.0010 

0.0010 

0.0334 

0.0010 

25 

1 

1 

0.9634 

0.0010 

0.0010 

0.0336 

0.0010 

26 

1 

1 

0.7833 

0.0010 

0.0010 

0.2137 

0 . 0010 

27 

1 

1 

0.7072 

0.0010 

0.0010 

0 . 2898 

0 . 0010 

28 

1 

1 

0.8328 

0.0017 

0.0010 

0 . 1635 

0.0010 

29 

1 

1 

0.8499 

0.0010 

0.0010 

0 . 1471 

0 . 0010 

30 

1 

1 

0.8297 

0.0010 

0.0010 

0 . 1673 

0.0010 

31 

1 

1 

0.7769 

0.0010 

0.0010 

0.2201 

0  0010 

32 

1 

1 

0.7838 

0.0010 

0.0010 

0.2132 

o  j  G 1  w 

33 

1 

1 

0.7676 

0.0010 

0  0010 

0 . 2294 

0  0  0 1 0 

34 

1 

1 

0.7818 

0.0010 

0  0010 

0  2152 
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36 

4 

4 

0.2524 

0.0010 

0.0010 

0.7446 

0.0010 

37 

4 

4 

0.0835 

0.0021 

0.0010 

0.9124 

0.0010 

38 

4 

4 

0.0918 

0.0018 

0.0012 

0.9043 

0.0010 

39 

4 

4 

0.0903 

0.0016 

0.0012 

0.9059 

0.0010 

40 

4 

4 

0.1073 

0.0010 

0.0010 

0.8896 

0.0010 

41 

4 

4 

0 . 1377 

0.0010 

0.0010 

0.8592 

0.0011 

42 

4 

4 

0.0449 

0.0010 

0.0010 

0.9521 

0.0010 

43 

4 

4 

0.0366 

0.0010 

0.0010 

0.9604 

0.0010 

44 

4 

4 

0 . 0422 

0.0011 

0.0010 

0.9544 

0.0012 

45 

4 

4 

0.0261 

0.0010 

0.0013 

0.9707 

0.0010 

46 

4 

4 

0.0267 

0.0010 

0.0010 

0.9703 

0.0010 

47 

4 

4 

0.0325 

0.0014 

0.0014 

0 . 9637 

0.0010 

48 

4 

4 

0.0286 

0.0010 

0.0010 

0 . 9684 

0.0010 

49 

4 

4 

0 . 0345 

0.0011 

0.0015 

0.9616 

0.0014 

50 

4 

4 

0 . 0040 

0.0010 

0.0010 

0.9930 

0.0010 

51 

4 

4 

0 . 0037. 

0.0010 

0.0011 

0.9932 

0.0010 

52 

4 

4 

0.0052 

0.0010 

0.0010 

0.9918 

0.0010 

53 

4 

4 

0.0114 

0.0018 

0.0010 

0.9842 

0.0016 

54 

4 

4 

0 . 0242 

0.0026 

0.0016 

0 . 9687 

0.0029 

55 

4 

4 

0 . 0343 

0 . 0026 

0.0021 

0.9585 

0.0025 

56 

4 

4 

0 . 0365 

0 . 0040 

0.0035 

0.9515 

0 . 0044 

57 

4 

4 

0.0411 

0 . 0036 

0.0035 

0 . 9496 

0.0022 

58 

4 

4 

0 . 0393 

0.0038 

0 . 0046 

0 . 9498 

0.0025 

59 

4 

4 

0 . 0276 

0.0019 

0.0019 

0.9682 

0.0013 

60 

4 

4 

0 . 0086 

0.0010 

0.0010 

0 . 9884 

0.0010 

61 

4 

4 

0.0174 

0.0010 

0.0018 

0 . 9785 

0.0012 

62 

4 

4 

0.0179 

0.0010 

0.0011 

0.9790 

0.0010 

63 

4 

4 

0.0369 

0.0014 

0.0029 

0.9564 

0.0024 

64 

4 

4 

0.0332 

0.0252 

0.0150 

0.8690 

0.0576 

65 

75 

2 

4 

0.0194 

0.1596 

0.0631 

0.4463 

0.3115 

66 

75 

2 

5 

0.0010 

0.4115 

0.0010 

0.0010 

0.5855 

67 

5 

5 

0.0010 

0 . 3375 

0.0035 

0.0010 

0.6571 

68 

5 

5 

0.0010 

0.3250 

0.0010 

0.0010 

0.6720 

69 

2 

2 

0.0010 

0.5609 

0.0010 

0.0010 

0.4361 

70 

2 

2 

0.0010 

0.5193 

0.0010 

0.0010 

0.4777 

71 

2 

2 

0.0010 

0.5114 

0  0010 

0.0010 

0.4856 

72 

5 

5 

0.0010 

0.2619 

0  0010 

0.0010 

0.7351 

73 

2 

2 

0.0010 

0 . 5050 

0.0010 

0.0010 

0.4920 

74 

5 

5 

0.0010 

0 . 2334 

0  0010 

0.0010 

0 . 7636 

75 

5 

5 

0  0010 

0 . 1971 

0 . 0010 

0.0010 

0  7999 

76 

2 

2 

0.0010 

0.9960 

0.0010 

0 .0010 

G . 2010 
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77 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 

78 

2 

2 

0.0014 

0.9941 

0.0014 

0.0015 

0.0016 

79 

2 

2 

0.0021 

0.9899 

0.0028 

0.0024 

0.0028 

80 

2 

2 

0.0057 

0.9721 

0.0059 

0.0084 

0.0079 

81 

2 

2 

0.0093 

0.9582 

0.0082 

0.0129 

0.0114 

82 

2 

2 

0 . 0245 

0.8937 

0.0176 

0.0352 

0.0292 

83 

2 

2 

0.0190 

0.9005 

0.0138 

0 . 0409 

0.0258 

84 

2 

2 

0.1003 

0.5316 

0.0794 

0.2063 

0.0824 

85 

75 

2 

4 

0.1452 

0.3067 

0 . 1334 

0.4017 

0.0130 

86 

70 

1 

4 

0.1871 

0.1637 

0.1797 

0.4611 

0.0085 

87 

70 

1 

4 

0 . 2382 

0.0168 

0.1750 

0.5682 

0.0018 

88 

4 

4 

0.2123 

0.0398 

0 . 0877 

0.6556 

0.0045 

89 

25 

1 

4 

0.3316 

0 . 0348 

0.1385 

0.4915 

0.0035 

90 

25 

1 

4 

0.3501 

0.0445 

0.1168 

0.4838 

0.0047 

91 

25 

1 

4 

0.3705 

0.0556 

0.0992 

0.4680 

0.0068 

92 

25 

1 

4 

0.3949 

0 . 0492 

0.1016 

0.4493 

0.0050 

93 

25 

1 

4 

0.3991 

0.0449 

0.0975 

0.4531 

0.0054 

94 

25 

1 

4 

0.4310 

0.0052 

0 . 0689 

0.4939 

0.0010 

95 

1 

1 

0 . 6342 

0.0010 

0.0811 

0.2827 

0.0010 

96 

1 

1 

0.7714 

0.0010 

0.0491 

0.1771 

0.0014 

97 

1 

1 

0.8393 

0.0010 

0.0397 

0.1182 

0.0018 

98 

1 

1 

0.8556 

0.0010 

0 . 0335 

0.1082 

0.0017 

99 

1 

1 

0 . 9089 

0.0010 

0.0329 

0.0562 

0.0010 

100 

1 

1 

0.8991 

0.0011 

0.0289 

0.0696 

0.0013 

101 

1 

1 

0.9223 

0.0010 

0.0203 

0.0554 

0.0010 

102 

1 

1 

0 . 9280 

0.0010 

0.0176 

0.0524 

0.0010 

103 

1 

1 

0.9232 

0.0010 

0.0725 

0.0023 

0.0010 

104 

1 

1 

0.9431 

0.0010 

0.0539 

0.0010 

0.0010 

105 

1 

1 

0 . 9479 

0.0010 

0.0491 

0.0010 

0.0010 

106 

1 

1 

0.9612 

0.0010 

0.0358 

0.0010 

0.0010 

107 

1 

1 

0.9527 

0.0019 

0.0429 

0.0010 

0.0014 

108 

1 

1 

0.9514 

0.0017 

0.0443 

0.0010 

0.0015 

109 

1 

1 

0 . 9554 

0.0017 

0.0402 

0.0010 

0.0017 

110 

1 

1 

0.9417 

0.0077 

0.0412 

0.0010 

0  0083 

111 

1 

1 

0.9378 

0.0075 

0.0444 

0.0010 

0.0093 

112 

1 

1 

0.9311 

0.0092 

0.0513 

0.0012 

0.0072 

113 

1 

1 

0.9150 

0.0232 

0.0522 

0.0013 

0.0084 

1 14 

1 

1 

0.8969 

0.0326 

0.0561 

0.0012 

0.0133 

115 

1 

1 

0.8866 

0.0396 

0.0627 

0.0010 

0.0101 

116 

1 

1 

0.7810 

0 . 1015 

0.0917 

0.0010 

0 . 0248 

117 

1 

1 

0.7207 

0 ,1235 

0. 1255 

0.0012 

0 . 0291 
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118 

2 

2 

0.2131 

0.5801 

0.1786 

0.0037 

0.0245 

119 

2 

2 

0 . 2427 

0.5218 

0.2107 

0.0036 

0.0212 

120 

55 

3 

2 

0 . 1646 

0.4378 

0.3703 

0 . 0033 

0 . 0240 

121 

55 

3 

2 

0.0569 

0.5240 

0.4081 

0.0023 

0.0087 

122 

55 

3 

2 

0 . 0454 

0.4991 

0.4461 

0.0023 

0.0072 

123 

3 

3 

0.1934 

0.0659 

0.7119 

0.0076 

0.0212 

124 

3 

3 

0 . 1903 

0.0464 

0.7371 

0.0068 

0.0194 

125 

3 

3 

0.0981 

0.0673 

0.8151 

0.0136 

0.0060 

126 

3 

3 

0.0517 

0.0628 

0.8666 

0.0147 

0 . 0042 

127 

3 

3 

0 . 0858 

0.1057 

0 . 7833 

0.0180 

0 . 0072 

128 

3 

3 

0.0178 

0.2702 

0.6952 

0.0142 

0.0026 

129 

3 

3 

0.0062 

0.3994 

0.5822 

0.0083 

0 . 0038 

130 

3 

3 

0.0057 

0.3650 

0.6203 

0.0069 

0.0022 

131 

3 

3 

0.0026 

0.4695 

0.5203 

0.0058 

0.0017 

132 

30 

3 

2 

0.0010 

0.5752 

0.4189 

0.0013 

0.0036 

133 

3 

3 

0.0022 

0.2635 

0.7300 

0.0027 

0.0016 

134 

3 

3 

0.0010 

0 . 2494 

0 . 7476 

0.0010 

0.0010 

135 

3 

3 

0.0010 

0.2126 

0.7844 

0.0010 

0.0010 

136 

3 

3 

0.0010 

0.2415 

0.7551 

0.0010 

0.0014 

137 

3 

3 

0.0010 

0 . 1898 

0.8068 

0.0010 

0.0014 

138 

3 

3 

0.0010 

0 . 1733 

0.8237 

0.0010 

0.0010 

139 

3 

3 

0.0010 

0.3832 

0.6134 

0.0010 

0.0014 

140 

3 

3 

0.0010 

0.4667 

0 . 5303 

0.0010 

0.0010 

141 

30 

3 

2 

0.0010 

0.6509 

0.3455 

0.0015 

0.0010 

142 

30 

3 

2 

0.0013 

0.5463 

0.4499 

0.0012 

0.0013 

143 

30 

3 

2 

0.0018 

0.5188 

0.4767 

0.0012 

0.0015 

144 

3 

3 

0.0010 

0.4584 

0.5381 

0.0010 

0.0015 

145 

3 

3 

0.0010 

0.4631 

0.5335 

0.0010 

0.0013 

146 

3 

3 

0.0010 

0.4267 

0.5703 

0.0010 

0.0010 

147 

3 

3 

0.0010 

0.4049 

0.5920 

0.0011 

0.0010 

148 

30 

3 

2 

0.0010 

0.5294 

0.4676 

0.0011 

0.0010 

149 

3 

3 

0.0011 

0.4604 

0.5363 

C.0010 

0.0011 

150 

3 

3 

0.0014 

0.0606 

0.9351 

0.0019 

0.0010 

151 

3 

3 

0.0020 

0.0268 

0.9662 

0.0040 

0.0010 

152 

3 

3 

0.0018 

0 . 0334 

0.9577 

0.0062 

0.0010 

153 

3 

3 

0.0039 

0.0834 

0.8813 

0.0298 

0.0016 

154 

3 

3 

0.0046 

0.0436 

0.9258 

0.0249 

0.0010 

155 

3 

3 

0.0055 

0.1924 

0.7499 

0.0511 

0.0012 

156 

3 

3 

0.0057 

0.1529 

0.8033 

0.0365 

0.0016 

157 

3 

3 

0.0036 

0.2770 

0.6914 

0.0255 

0.0024 

158 

3 

3 

0.0029 

0.2436 

0.7266 

0.0241 

0.0028 

159 

3 

3 

0.0017 

0.3131 

0.6603 

0.0208 

0 . 0041 

160 

3 

3 

0.0028 

0.2789 

0.6825 

0 . 0348 

0.0010 

161 

3 

3 

0.0029 

0.2175 

0.7348 

0 . 0438 

0.0010 

162 

3 

3 

0.0010 

0.0384 

0.8851 

0 . 0745 

0.0010 

163 

3 

3 

0.0010 

0.0053 

0.9696 

0.0231 

0.0010 

164 

3 

3 

0.0013 

0.0058 

0.9801 

0.0100 

0.0028 

165 

3 

3 

0.0017 

0.0035 

0.9858 

0 . 0037 

0.0053 

166 

3 

3 

0.0010 

0.0032 

0.9902 

0 . 0043 

0.0013 

167 

3 

3 

0.0010 

0.0018 

0.9918 

0 . 0043 

0.0010 

168 

3 

3 

0.0010 

0.0023 

0.9900 

0.0057 

0.0010 

169 

3 

3 

0.0010 

0.0016 

0.9905 

0.0059 

0.0010 

170 

3 

3 

0.0010 

0.0014 

0.9916 

0.0050 

0.0010 

171 

3 

3 

0.0010 

0.0039 

0.9664 

0 . 0277 

0.0010 

172 

3 

3 

0.0023 

0.0052 

0.9352 

0.0554 

0.0019 

173 

3 

3 

0.0029 

0.0047 

0.9451 

0.0446 

0.0027 

174 

3 

3 

0.0047 

0.0083 

0.9393 

0 . 0405 

0 . 0072 

175 

3 

3 

0.0036 

0.0063 

0.9557 

0 . 0273 

0.0072 

176 

3 

3 

0.0050 

0.0071 

0.9484 

0.0293 

0.0102 

177 

3 

3 

0.0044 

0.0091 

0.9503 

0.0204 

0.0158 

178 

3 

3 

0.0041 

0.0087 

0 . 9540 

0.0172 

0.0160 

179 

3 

3 

0.0047 

0.0100 

0.9511 

0.0136 

0.0205 

180 

3 

3 

0.0054 

0.0022 

0.9741 

0.0128 

0.0055 

181 

3 

3 

0.0048 

0.0014 

0.9789 

0.0102 

0 . 0047 

182 

3 

3 

0.0066 

0.002. 

0.9722 

0.0149 

0 . 0043 

183 

3 

3 

0.0058 

0.0017 

0 . 9770 

0.0131 

0 . 0024 

184 

3 

3 

0.0050 

0.0019 

0.9771 

0.0142 

0.0018 

185 

3 

3 

0.0040 

0.0018 

0 . 9748 

0.0185 

0.0010 

186 

3 

3 

0.0028 

0.0031 

0.9066 

0 . 0863 

0.0013 

187 

3 

3 

0.0016 

0.0027 

0.9199 

0 . 0747 

0.0010 

188 

3 

3 

0.0010 

0.0048 

0.9157 

0 . 0775 

0.0010 

189 

3 

3 

0.0010 

0.0070 

0.8824 

0.1086 

0.0010 

190 

3 

3 

0.0010 

0.0060 

0.8900 

0.1020 

0.0010 

191 

3 

3 

0.0021 

0.0014 

0.8796 

0.1158 

0.0010 

192 

3 

3 

0.0014 

0.0018 

0.8962 

0.0993 

0.0012 

193 

3 

3 

0.0010 

0.0019 

0.8669 

0.1293 

0.0010 

194 

3 

3 

0.0010 

0.0021 

0.8317 

0.1642 

0.0010 

195 

3 

3 

0.0015 

0.0022 

0.7720 

0.2230 

0.0013 

196 

3 

3 

0.0010 

0.0107 

0.6231 

0.3642 

0.0010 

197 

3 

3 

0.0010 

0.0063 

0.5988 

0.3926 

0.0012 

198 

3 

3 

0.0013 

0.0056 

0.5393 

0.4524 

0.0014 

199 

3 

3 

0.0010 

0.0061 

0.5050 

0.4869 

0.0010 

109 
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200 

4 

4 

0.0012 

0.0155 

0.4300 

0.5500 

0 . 0034 

201 

4 

4 

0.0015 

0.0110 

0.4515 

0.5328 

0 . 0032 

202 

4 

4 

0.0017 

0.0137 

0.4806 

0.4996 

0.0044 

203 

3 

3 

0.0015 

0.0146 

0.5544 

0.4245 

0 . 0049 

204 

3 

3 

0.0018 

0.0137 

0.5498 

0.4296 

0.0052 

205 

3 

3 

0.0021 

0.0126 

0.5444 

0.4377 

0.0033 

206 

3 

3 

0.0012 

0.0257 

0.4943 

0.4746 

0 . 0042 

207 

3 

3 

0.0010 

0.0352 

0.5340 

0.4232 

0.0067 

208 

3 

3 

0.0010 

0.0375 

0.5512 

0.4042 

0.0061 

209 

3 

3 

0.0010 

0.1098 

0.6205 

0.2621 

0.0066 

210 

3 

3 

0.0010 

0.0870 

0.6674 

0.2396 

0.0050 

211 

3 

3 

0.0010 

0.0541 

0.6694 

0.2735 

0.0020 

212 

3 

3 

0.0010 

0.0688 

0.5826 

0.3461 

0.0014 

213 

3 

3 

0.0010 

0.0880 

0.6131 

0.2968 

0.0011 

214 

3 

3 

0.0010 

0.0702 

0.6296 

0.2982 

0.0010 

215 

3 

3 

0.0010 

0.0791 

0.5750 

0 . 3439 

0.0010 

216 

3 

3 

0.0011 

0.0643 

0.6220 

0.3117 

0.0010 

217 

3 

3 

0.0015 

0.0613 

0.6449 

0.2911 

0.0012 

218 

3 

3 

0.0013 

0.0161 

0.6665 

0.3152 

0.0010 

219 

4 

4 

0.0016 

0.0101 

0.3571 

0 . 6303 

0.0010 

220 

4 

4 

0.0010 

0.0078 

0.2996 

0.6907 

0.0010 

221 

4 

4 

0.0010 

0.0101 

0.2346 

0 . 7533 

0.0010 

222 

4 

4 

0.0010 

0.0085 

0 . 2304 

0.7592 

0.0010 

223 

4 

4 

0.0010 

0 . 0069 

0.2628 

0.7283 

0.0010 

224 

4 

4 

0.0010 

0.0086 

0.2292 

0.7602 

0.0010 

225 

4 

4 

0.0010 

0.0118 

0.2680 

0.7181 

0.0010 

226 

4 

4 

0.0011 

0.0364 

0.4454 

0.5148 

0.0023 

227 

4 

4 

0.0010 

0.0482 

0.4090 

0 . 5394 

0.0024 

228 

4 

4 

0.0012 

0 . 0350 

0.3057 

0.6572 

0.0010 

229 

4 

4 

0.0010 

0.0253 

0.2833 

0.6895 

0.0010 

230 

4 

4 

0.0010 

0.0159 

0.0326 

0.9495 

0.0010 

231 

4 

4 

0.0010 

0.0154 

0.0323 

0.9504 

0.0010 

232 

4 

4 

0.0010 

0.0130 

0.0326 

0.9523 

0.0010 

233 

4 

4 

0.0018 

0.0170 

0.0262 

0.9534 

0.0016 

234 

4 

4 

0.0012 

0.0167 

0.0273 

0.9537 

0.0010 

235 

4 

4 

0.0014 

0.0120 

0.0283 

0.9573 

0.0010 

236 

4 

4 

0.0014 

0.0112 

0.0306 

0.9558 

0.0010 

237 

4 

4 

0.0016 

0.0102 

0.0327 

0.9544 

0.0011 

238 

4 

4 

0.0022 

0.0067 

0.0340 

0.9561 

0.0010 

239 

4 

4 

0.0010 

0.0010 

0.1409 

0.8560 

0.0011 

240 

4 

4 

0.0027 

0.0010 

0.2164 

0.7773 

0.0025 

r 
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#  Rule 

KR 

MAP 

PI 

P2 

P3 

P4 

P5 

1 

1 

1 

0.9600 

0.0100 

0.0100 

0.0100 

0.0100 

2 

1 

1 

0.9600 

0.0100 

0.0100 

0.0100 

0.0100 

3 

1 

1 

0.9605 

0.0092 

0.0100 

0.0103 

0.0099 

4 

1 

1 

0 . 9644 

0.0014 

0.0091 

0.0178 

0.0073 

5 

1 

1 

0.9046 

0.0040 

0.0140 

0.0676 

0.0098 

6 

1 

1 

0.8829 

0.0051 

0.0122 

0.0900 

0.0099 

7 

1 

1 

0.8849 

0.0014 

0.0082 

0.0967 

0.0087 

8 

1 

1 

0.8909 

0.0013 

0.0079 

0.0918 

0.0081 

9 

1 

1 

0.9001 

0.0010 

0.0077 

0 . 0841 

0.0071 

10 

1 

1 

0.9025 

0.0013 

0.0068 

0.0812 

0.0082 

11 
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4 

0.0041 

0.0018 

0.0233 

0.9689 

0.0019 

199 

4 

4 

0.0040 

0.0017 

0.0220 

0.9707 

0.0016 
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200 

4 

4 

0.0032 

0.0021 

0.0092 

0.9838 

0.0017 

m 

201 

4 

4 

0.0035 

0.0020 

0.0094 

0.9836 

0.0014 

Bw 

202 

4 

4 

0.0050 

0.0026 

0.0102 

0.9801 

0.0020 

203 

4 

4 

0.0059 

0.0024 

0.0107 

0.9787 

0.0022 

m 

204 

4 

4 

0.0053 

0.0022 

0.0105 

0.9801 

0.0020 

205 

4 

4 

0.0064 

0.0020 

0.0100 

0.9798 

0.0018 

S5K 

206 

4 

4 

0.0069 

0.0024 

0.0073 

0.9809 

0.0026 

207 

4 

4 

0.0081 

0.0033 

0.0078 

0.9764 

0.0045 

208 

4 

4 

0.0104 

0.0030 

0.0087 

0.9729 

0.0050 

-  ly! 

209 

4 

4 

0.0097 

0.0091 

0.0146 

0.9529 

0.0137 

yy; 

210 

4 

4 

0.0099 

0.0074 

0.0144 

0.9551 

0.0131 

■* 

211 

4 

4 

0.0101 

0.0067 

0.0096 

0.9654 

0.0082 

• 

212 

4 

4 

0.0049 

0.0062 

0.0071 

0.9766 

0.0052 

213 

4 

4 

0.0051 

0.0065 

0.0058 

0.9763 

0.0063 

214 

4 

4 

0.0065 

0.0058 

0.0053 

0.9755 

0.0069 

215 

4 

4 

0.0055 

0.0047 

0.0055 

0.9819 

0.0024 

(V. 

m  *  a 

216 

4 

4 

0.0072 

0.0037 

0.0051 

0.9825 

0.0014 

JP  —  ^ 

• 

217 

4 

4 

0.0108 

0.0034 

0.0056 

0 . 9787 

0.0015 

,w«; 

V.  .» 

218 

4 

4 

0.0115 

0.0013 

0.0107 

0.9755 

0.0010 

vv 

219 

4 

4 

0.0148 

0.0010 

0.0050 

0.9782 

0.0010 

:>\v 

220 

4 

4 

0.0114 

0.0010 

0 . 0043 

0.9823 

0.0010 

» 

•  ft  *  J 

221 

4 

4 

0.0060 

0.0010 

0.0028 

0.9892 

0.0010 

• 

222 

4 

4 

0.0070 

0.0010 

0.0027 

0.9882 

0.0010 

-\V 

• .  •  j 

223 

4 

4 

0.0065 

0.0010 

0.0033 

0.9882 

0.0010 

224 

4 

4 

0.0090 

0.0010 

0.0025 

0.9865 

0.0010 

■* .  * 

225 

4 

4 

0.0062 

0.0010 

0.0017 

0.9901 

0.0010 

226 

4 

4 

0.0062 

0.0019 

0.0021 

0.9875 

0.0022 

>  V 

• 

227 

4 

4 

0.0079 

0.0026 

0.0019 

0.9842 

0.0035 

228 

4 

4 

0.0102 

0.0028 

0.0014 

0.9825 

0.0030 

229 

4 

4 

0.0141 

0.0015 

0.0016 

0.9792 

0.0036 

sss 

230 

4 

4 

0.0017 

0.0031 

0.0010 

0.9932 

0.0010 

•  *  *  * 

"V  "S. 

231 

4 

4 

0.0017 

0.0035 

0.0010 

0.9927 

0.0010 

a 

232 

4 

4 

0.0023 

0.0032 

0.0010 

0.9924 

0.0012 

w 

233 

4 

4 

0.0023 

0.0033 

0.0010 

0.9924 

0.0010 

234 

4 

4 

0.0026 

0.0028 

0.0010 

0.9926 

0.0010 

235 

4 

4 

0.0034 

0.0021 

0.0010 

0.9926 

0.0010 

236 

4 

4 

0.0048 

0.0021 

0.0012 

0.9907 

0.0012 

237 

4 

4 

0.0053 

0.0020 

0.0013 

0.9902 

0.0012 

238 

4 

4 

0.0066 

0.0013 

0.0014 

0.9894 

0.0012 

V' 

•V« 

239 

4 

4 

0.0143 

0.0010 

0.0120 

0.9696 

0.0032 

V* 

240 

4 

4 

0.0345 

0.0010 

0.0236 

0.9359 

0.0050 

*  N*  » 

•  1 

vs 

Vvw 

i 


vN 


KREST :  .Caiman  filter  Expert  SysTem. 
NFRMS:  240 
ITraj :  5 


#  Rule 

KR 

MAP 

PI 

P2 

P3 

P4 

P5 

1 

1 

1 

0.9600 

0.0100 

0.0100 

0.0100 

0.0100 

2 

1 

1 

0.9600 

0.0100 

0.0100 

0.0100 

0.0100 

3 

1 

1 

0.9605 

0.0092 

0.0100 

0.0103 

0.0099 

4 

1 

1 

0.9644 

0.0014 

0.0091 

0.0178 

0.0073 

5 

1 

1 

0.9046 

0.0040 

0.0140 

0.0676 

0.0098 

6 

1 

1 

0.8829 

0.0051 

0.0122 

0.0900 

0.0099 

7 

1 

1 

0.8849 

0.0014 

0.0082 

0.0967 

0.0087 

8 

1 

1 

0.8909 

0.0013 

0.0079 

0.0918 

0.0081 

9 

1 

1 

0.9001 

0.0010 

0.0077 

0.0841 

0.0071 

10 

1 

1 

0.9025 

0.0013 

0.0068 

0.0812 

0.0082 

11 

1 

1 

0.8835 

0.0010 

0.0070 

0.1001 

0.0084 

12 

1 

1 

0.8835 

0.0010 

0.0059 

0.1036 

0.0060 

13 

1 

1 

0.8625 

0.0010 

0.0053 

0.1255 

0.0057 

14 

1 

1 

0.8797 

0.0010 

0.0040 

0.1121 

0.0032 

15 

1 

1 

0.8957 

0.0010 

0.0039 

0.0964 

0.0030 

16 

1 

1 

0.8840 

0.0010 

0.0038 

0 . 1083 

0.0029 

17 

1 

1 

0 . 8948 

0.0010 

0.0039 

0.0979 

0.0024 

18 

1 

1 

0.9270 

0.0010 

0.0039 

0.0672 

0.0010 

19 

1 

1 

0.8661 

0.0010 

0.0025 

0.1294 

0.0010 

20 

1 

1 

0.9143 

0.0010 

0.0010 

0.0827 

0.0010 

21 

1 

1 

0.9020 

0.0010 

0.0010 

0.0949 

0.0011 

22 

1 

1 

0.9586 

0.0010 

0.0012 

0.0383 

0.0010 

23 

1 

1 

0.9668 

0.0010 

0.0010 

0.0302 

0.0010 

24 

1 

1 

0.9636 

0.0010 

0.0010 

0 . 0334 

0.0010 

25 

1 

1 

0.9634 

0.0010 

0.0010 

0.0336 

0.0010 

26 

1 

1 

0.7833 

0.0010 

0.0010 

0.2137 

0.0010 

27 

1 

1 

0.7072 

0.0010 

0.0010 

0 . 2898 

0.0010 

28 

1 

1 

0.8328 

0.0017 

0.0010 

0.1635 

0.0010 

29 

1 

1 

0.8499 

0.0010 

0.0010 

0.1471 

0.0010 

30 

1 

1 

0.8297 

0.0010 

0.0010 

0.1673 

0.0010 

31 

1 

1 

0.7769 

0.0010 

0.0010 

0.2201 

0.0010 

32 

1 

1 

0.7838 

0.0010 

0.0010 

0.2132 

0.0010 

33 

1 

1 

0.7676 

0.0010 

0.0010 

0.2294 

0.0010 

34 

1 

1 

0.7818 

0.0010 

0.0010 

0.2152 

0.0010 

35  65 

1 

4 

0.3677 

0.0010 

0.0010 

0.6293 

0.0010 
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36 

4 

4 

0.2524 

0.0010 

0.0010 

0.7446 

0.0010 

37 

4 

4 

0.0835 

0.0021 

0.0010 

0.9124 

0.0010 

38 

4 

4 

0.0918 

0.0018 

0.0012 

0.9043 

0.0010 

39 

4 

4 

0.0903 

0.0016 

0.0012 

0.9059 

0.0010 

40 

4 

4 

0.1073 

0.0010 

0.0010 

0.8896 

0.0010 

41 

4 

4 

0 . 1377 

0.0010 

0.0010 

0.8592 

0.0011 

42 

4 

4 

0.0449 

0.0010 

0.0010 

0.9521 

0.0010 

43 

4 

4 

0.0366 

0.0010 

0.0010 

0.9604 

0.0010 

44 

4 

4 

0.0422 

0.0011 

0.0010 

0.9544 

0.0012 

45 

4 

4 

0.0261 

0.0010 

0.0013 

0.9707 

0.0010 

46 

4 

4 

0.0267 

0.0010 

0.0010 

0.9703 

0.0010 

47 

4 

4 

0.0325 

0.0014 

0.0014 

0.9637 

0.0010 

48 

4 

4 

0.0286 

0.0010 

0.0010 

0.9684 

0.0010 

49 

4 

4 

0.0345 

0.0011 

0.0015 

0.9616 

0.0014 

50 

4 

4 

0.0040 

0.0010 

0.0010 

0.9930 

0.0010 

51 

4 

4 

0.0037 

0.0010 

0.0011 

0.9932 

0.0010 

52 

4 

4 

0.0052 

0.0010 

0.0010 

0.9918 

0.0010 

53 

4 

4 

0.0114 

0.0018 

0.0010 

0 . 9842 

0.0016 

54 

4 

4 

0 . 0242 

0.0026 

0.0016 

0.9687 

0.0029 

55 

4 

4 

0 . 0343 

0.0026 

0.0021 

0.9585 

0.0025 

56 

4 

4 

0 . 0365 

0 . 0040 

0.0035 

0.9515 

0 . 0044 

57 

4 

4 

0.0411 

0 . 0036 

0.0035 

0.9496 

0.0022 

58 

4 

4 

0.0393 

0 . 0038 

0.0046 

0 . 9498 

0.0025 

59 

4 

4 

0.0276 

0.0010 

0.0019 

0.9682 

0.0013 

60 

4 

4 

0.0086 

0.0010 

0.0010 

0 . 9884 

0.0010 

61 

4 

4 

0.0174 

0.0010 

0.0018 

0.9785 

0.0012 

62 

4 

4 

0.0179 

0.0010 

0.0011 

0.9790 

0.0010 

63 

4 

4 

0.0369 

0.0014 

0.0029 

0.9564 

0.0024 

64 

4 

4 

0.0332 

0.0252 

0.0150 

0.8690 

0.0576 

65 

75 

2 

4 

0.0194 

0.1596 

0.0631 

0.4463 

0.3115 

66 

75 

2 

5 

0.0010 

0.4115 

0.0010 

0.0010 

0.5855 

67 

5 

5 

0.0010 

0 . 3375 

0.0035 

0.0010 

0.6571 

68 

5 

5 

0.0010 

0.3250 

0.0010 

0.0010 

0.6720 

69 

2 

2 

0.0010 

0.5609 

0.0010 

0.0010 

0.4361 

70 

2 

2 

0.0010 

0.5193 

0.0010 

0.0010 

0.4777 

71 

2 

2 

0.0010 

0.5114 

0.0010 

0.0010 

0.4856 

72 

5 

5 

0.0010 

0.2619 

0.0010 

0.0010 

0.7351 

73 

2 

2 

0.0010 

0.5050 

0.0010 

0.0010 

0.4920 

74 

5 

5 

0.0010 

0 . 2334 

0.0010 

0.0010 

0.7636 

75 

5 

5 

0.0010 

0.1971 

0.0010 

0.0010 

0.7999 

76 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 
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77 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 

78 

2 

2 

0.0014 

0.9941 

0.0014 

0.0015 

0.0016 

79 

2 

2 

0.0021 

0.9899 

0.0028 

0.0024 

0.0028 

80 

2 

2 

0.0057 

0.9721 

0.0059 

0.0084 

0.0079 

81 

2 

2 

0.0093 

0.9582 

0.0082 

0.0129 

0.0114 

82 

2 

2 

0.0245 

0.8937 

0.0176 

0.0352 

0.0292 

83 

2 

2 

0.0190 

0.9005 

0.0138 

0.0409 

0.0258 

84 

2 

2 

0.1003 

0.5316 

0.0794 

0.2063 

0.0824 

85 

75 

2 

4 

0.1452 

0.3067 

0 . 1334 

0.4017 

0.0130 

86 

70 

1 

4 

0.1871 

0.1637 

0.1797 

0.4611 

0.0085 

87 

70 

1 

4 

0.2382 

0.0168 

0.1750 

0.5682 

0.0018 

88 

4 

4 

0.2123 

0.0398 

0.0877 

0.6556 

0.0045 

89 

25 

1 

4 

0.3316 

0 . 0348 

0.1385 

0.4915 

0.0035 

90 

25 

1 

4 

0.3501 

0.0445 

0.1168 

0.4838 

0 . 0047 

91 

25 

1 

4 

0.3705 

0.0556 

0.0992 

0.4680 

0.0068 

92 

25 

1 

4 

0.3949 

0.0492 

0.1016 

0.4493 

0.0050 

93 

25 

1 

4 

0.3991 

0.0449 

0.0975 

0.4531 

0.0054 

94 

25 

1 

4 

0.4310 

0.0052 

0.0689 

0.4939 

0.0010 

95 

1 

1 

0 . 6342 

0.0010 

0.0811 

0.2827 

0.0010 

96 

1 

1 

0.7714 

0.0010 

0.0491 

0.1771 

0.0014 

97 

1 

1 

0.8393 

0.0010 

0.0397 

0.1182 

0.0018 

98 

1 

1 

0.8556 

0.0010 

C . 0335 

0.1082 

0.0017 

99 

1 

1 

0.9089 

0.0010 

0.0329 

0.0562 

0.0010 

100 

1 

1 

0.8991 

0.0011 

0.0289 

0.0696 

0.0013 

101 

1 

1 

0.9223 

0.0010 

0.0203 

0.0554 

0.0010 

102 

1 

1 

0.9280 

0.0010 

0.0176 

0.0524 

0.0010 

103 

1 

1 

0.9232 

0.0010 

0.0725 

0.0023 

0.0010 

104 

1 

1 

0.9431 

0.0010 

0.0539 

0.0010 

0.0010 

105 

1 

1 

0 . 9479 

0.0010 

0.0491 

0.0010 

0.0010 

106 

1 

1 

0.9612 

0.0010 

0.0358 

0.0010 

0.0010 

107 

1 

1 

0.9564 

0.0011 

0.0403 

0.0010 

0.0011 

108 

1 

1 

0.9655 

0.0010 

0.0315 

0.0010 

0.0010 

109 

1 

1 

0.9631 

0.0010 

0.0339 

0.0010 

0.0010 

110 

1 

1 

0.9614 

0.0010 

0.0354 

0.0012 

0.0010 

111 

1 

1 

0.7283 

0.0103 

0.2443 

0.0011 

0.0160 

112 

45 

2 

5 

0.0086 

0.1135 

0.3011 

0.0010 

0.5758 

113 

2 

2 

0.0010 

0.8840 

0.0874 

0.0010 

0.0265 

114 

2 

2 

0.0010 

0.9270 

0.0432 

0.0010 

0.0278 

115 

2 

2 

0.0010 

0.9513 

0.0030 

0.0010 

0 . 0438 

116 

2 

2 

0.0010 

0.9262 

0.0048 

0.0010 

0.0670 

117 

2 

2 

0.0010 

0.9198 

0.0021 

0.0010 

0.0761 

128 


119 

2 

2 

120 

2 

2 

121 

2 

2 

122 

2 

2 

123 

2 

2 

124 

2 

2 

125 

2 

2 

126 

55 

3 

2 

127 

55 

3 

2 

128 

55 

3 

2 

129 

30 

3 

2 

130 

3 

3 

131 

3 

3 

132 

3 

3 

133 

3 

3 

134 

3 

3 

135 

3 

3 

136 

3 

3 

137 

3 

3 

138 

3 

3 

139 

3 

3 

140 

3 

3 

141 

3 

3 

142 

3 

3 

143 

3 

3 

144 

3 

3 

145 

3 

3 

146 

3 

3 

147 

3 

3 

148 

3 

3 

149 

3 

3 

150 

3 

3 

151 

3 

3 

152 

3 

3 

153 

3 

3 

154 

3 

3 

155 

3 

3 

156 

3 

3 

157 

3 

3 

158 

3 

3 

0.0010 

0.8522 

0 

0.0010 

0.9201 

0 

0.0010 

0.9271 

0 

0.0010 

0.8382 

0 

0.0010 

0.8268 

0 

0.0010 

0.9464 

0 

0.0010 

0.9529 

0 

0.0010 

0.7492 

0 

0.0010 

0.5822 

0 

0.0010 

0.5304 

0 

0.0010 

0 . 5449 

0 

0.0010 

0.5924 

0 

0.0010 

0.2277 

0 

0.0010 

0.1191 

0 

0.0010 

0.1939 

0 

0.0010 

0.1187 

0 

0.0012 

0 . 1320 

0 

0.0010 

0.1202 

0 

0.0010 

0 . 1325 

0 

0.0010 

0.1275 

0 

0.0013 

0.1152 

0 

0.0014 

0.2264 

0 

0.0014 

0.2154 

0 

0.0010 

0.0514 

0, 

0.0017 

0.0143 

0, 

0.0052 

0 . 0244 

0. 

0.0038 

0.0185 

0. 

0.0039 

0.0161 

0. 

0.0036 

0.0162 

0. 

0 . 0040 

0.0172 

c. 

0.0047 

0.0247 

0. 

0.0054 

0.0202 

0. 

0.0127 

0.0011 

0. 

0.0139 

0.0010 

0. 

0.0290 

0.0039 

0. 

0.0374 

0.0021 

0. 

0.0498 

0.0020 

0. 

0.0475 

0.0037 

0. 

0.0461 

0.0031 

0. 

0.0204 

0.0045 

0. 

0.0195 

0.0043 

0. 

.0023 

0.0010 

0 . 1435 

.0018 

0.0010 

0.0761 

.0097 

0.0010 

0.0612 

.0275 

0.0010 

0.1323 

.0152 

0.0010 

0.1560 

.0150 

0.0010 

0.0366 

.0193 

0.0010 

0.0259 

.1615 

0.0010 

0 . 0873 

.2804 

0.0010 

0.1354 

.4445 

0.0010 

0.0231 

.3956 

0.0010 

0.0575 

.3556 

0.0010 

0.0500 

.7148 

0.0010 

0.0556 

.8445 

0.0010 

0.0344 

.7683 

0.0010 

0 . 0357 

.8657 

0.0010 

0.0136 

.8500 

0.0010 

0.0159 

.8690 

0.0010 

0.0088 

.8611 

0.0010 

0.0044 

.8667 

0.0010 

0 . 0038 

.8790 

0.0010 

0.0035 

.7633 

0.0015 

0.0075 

.7762 

0.0017 

0.0053 

9376 

0.0065 

0 . 0036 

9739 

0.0066 

0.0036 

9496 

0.0117 

0.0091 

9595 

0.0105 

0.0078 

9630 

0.0099 

0.0072 

9633 

0.0113 

0.0056 

9591 

0.0150 

0 . 0048 

9479 

0.0170 

0.0057 

9517 

0.0169 

0.0058 

9540 

0.0298 

0.0023 

9615 

0.0226 

0.0010 

8307 

0.1342 

0.0022 

8202 

0.1380 

0.0022 

7895 

0.1571 

0.0016 

7082 

0.2396 

0.0010 

7863 

0.1630 

0.0015 

8043 

0.1692 

0.0016 

8521 

0.1225 

0.0015 

159 

3 

3 

0.0179 

0.0044 

0.8583 

0.1176 

0.0018 

160 

3 

3 

0.0329 

0.0038 

0.7195 

0.2428 

0.0010 

161 

3 

3 

0.0407 

0.0028 

0.6369 

0.3186 

0.0010 

162 

3 

3 

0.0010 

0.0010 

0.6815 

0.3155 

0.0010 

163 

3 

3 

0.0010 

0.0010 

0.8439 

0.1531 

0.0010 

164 

3 

3 

0.0027 

0.0010 

0.9245 

0.0693 

0.0025 

165 

3 

3 

0.0059 

0.0010 

0.9398 

0.0490 

0.0043 

166 

3 

3 

0.0067 

0.0010 

0.9349 

0.0540 

0.0033 

167 

3 

3 

0.0061 

0.0011 

0.9194 

0.0708 

0.0027 

168 

3 

3 

0.0030 

0.0013 

0.9319 

0.0627 

0.0011 

169 

3 

3 

0.0028 

0.0011 

0.9365 

0.0587 

0.0010 

170 

3 

3 

0.0031 

0.0010 

0.9393 

0.0556 

0.0010 

171 

3 

3 

0.0010 

0.0010 

0.7560 

0.2410 

0.0010 

172 

4 

4 

0.0036 

0.0010 

0.3871 

0.6061 

0.0022 

173 

4 

4 

0.0072 

0.0010 

0.4308 

0.5581 

0.0029 

174 

4 

4 

0.0158 

0.0010 

0 . 4373 

0.5419 

0 . 0040 

175 

4 

4 

0.0177 

0.0010 

0.4128 

0 . 5643 

0.0041 

176 

4 

4 

0.0210 

0.0011 

0.3671 

0.6089 

0.0019 

177 

4 

4 

0.0155 

0.0011 

0.2894 

0.6927 

0.0013 

178 

4 

4 

0.0120 

0.0010 

0.2353 

0.7508 

0.0010 

179 

4 

4 

0.0104 

0.0010 

0.2325 

0.7551 

0.0010 

180 

4 

4 

0.0091 

0.0010 

0.1698 

0.8187 

0.0014 

181 

4 

4 

0.0062 

0.0010 

0.1598 

0.8320 

0.0010 

182 

4 

4 

0.0074 

0.0011 

0.0906 

0.8998 

0.0011 

183 

4 

4 

0.0135 

0.0010 

0.1491 

0 . 8344 

0.0021 

184 

4 

4 

0.0153 

0.0010 

0.1486 

0 . 8333 

0.0018 

185 

4 

4 

0.0172 

0.0010 

0.1869 

0.7930 

0.0020 

186 

4 

4 

0.0082 

0.0010 

0.1101 

0.8797 

0.0010 

187 

4 

4 

0.0099 

0.0010 

0.1108 

0 . 8773 

0.0010 

188 

4 

4 

0.0087 

0.0010 

0.1149 

0 . 8742 

0.0012 

189 

4 

4 

0.0023 

0.0010 

0.0573 

0 . 9384 

0.0010 

190 

4 

4 

0.0031 

0.0011 

0.0538 

0 . 9407 

0.0012 

191 

4 

4 

0.0056 

0.0010 

0.0768 

0.9142 

0.0024 

192 

4 

4 

0.0078 

0.0025 

0.1527 

0.8308 

0.0063 

193 

4 

4 

0.0042 

0.0010 

0.1079 

0.8822 

0.0047 

194 

4 

4 

0.0045 

0.0010 

0.1008 

0.8907 

0 . 0030 

195 

4 

4 

0.0067 

0.0010 

0.1009 

0.8881 

0.0032 

196 

4 

4 

0.0022 

0.0010 

0.0378 

0.9580 

0.0010 

197 

4 

4 

0.0034 

0.0015 

0.0370 

0.9567 

0.0014 

198 

4 

4 

0.0042 

0.0011 

0.0275 

0.9659 

0.0012 

199 

4 

4 

0.0039 

0.0010 

0.0265 

0.9675 

0.0011 

130 


200 

4 

4 

0.0034 

0.0011 

0.0191 

0 . 9754 

0.0010 

201 

4 

4 

0.0047 

0.0010 

0.0148 

0.9785 

0.0010 

202 

4 

4 

0.0053 

0.0010 

0.0146 

0.9781 

0.0010 

203 

4 

4 

0.0073 

0.0010 

0.0154 

0.9750 

0.0012 

204 

4 

4 

0.0072 

0.0010 

0.0108 

0.9800 

0.0010 

205 

4 

4 

0.0065 

0.0010 

0.0081 

0.9834 

0.0010 

206 

4 

4 

0.0054 

0.0010 

0.0053 

0.9873 

0.0010 

207 

4 

4 

0.0070 

0.0010 

0.0052 

0.9853 

0.0014 

208 

4 

4 

0.0080 

0.0010 

0.0055 

0.9842 

0.0012 

209 

4 

4 

0.0096 

0.0015 

0.0057 

0.9822 

0.0011 

210 

4 

4 

0.0093 

0.0013 

0.0054 

0.9829 

0.0011 

211 

4 

4 

0.0074 

0.0010 

0.0033 

0 . 9874 

0.0010 

212 

4 

4 

0.0028 

0.0010 

0.0017 

0.9935 

0.0010 

213 

4 

4 

0.0027 

0.0010 

0.0014 

0.9939 

0.0010 

214 

4 

4 

0.0029 

0.0010 

0.0011 

0.9940 

0.0010 

215 

4 

4 

0.0024 

0.0015 

0.0014 

0 . 9937 

0.0010 

216 

4 

4 

0.0030 

0.0013 

0.0014 

0.9933 

0.0010 

217 

4 

4 

0.0041 

0.0013 

0.0016 

0.9919 

0.0011 

218 

4 

4 

0 . 0077 

0.0017 

0.0060 

0.9818 

0.0027 

219 

4 

4 

0.0092 

0.0010 

0.0041 

0 . 9846 

0.0010 

220 

4 

4 

0.0078 

0.0010 

0.0028 

0 . 9875 

0.0010 

221 

4 

4 

0.0036 

0.0010 

0.0017 

0.9927 

0.0010 

222 

4 

4 

0.0044 

0.0010 

0.0017 

0.9918 

0.0011 

223 

4 

4 

0.0057 

0.0019 

0 . 0034 

0.9870 

0.0020 

224 

4 

4 

0.0066 

0.0013 

0.0026 

0.9882 

0.0013 

225 

4 

4 

0.0057 

0.0012 

0.0020 

0.9900 

0.0011 

226 

4 

4 

0.0139 

0.0058 

0.0051 

0.9725 

0.0027 

227 

4 

4 

0.0155 

0.0050 

0.0042 

0.9721 

0.0031 

228 

4 

4 

0.0158 

0.0024 

0.0018 

0.9791 

0.0010 

229 

4 

4 

0.0216 

0.0024 

0.0021 

0.9727 

0.0011 

230 

4 

4 

0.0041 

0.0046 

0.0010 

0.9894 

0.0010 

231 

4 

4 

0.0037 

0.0015 

0.0010 

0.9928 

0.0010 

232 

4 

4 

0.0037 

0.0010 

0.0010 

0.9933 

0.0010 

233 

4 

4 

0.0076 

0.0020 

0.0010 

0 . 9879 

0.0015 

234 

4 

4 

0.0085 

0.0014 

0.0010 

0.9879 

0.0013 

235 

4 

4 

0.0106 

0.0016 

0.0012 

0.9849 

0.0017 

236 

4 

4 

0.0133 

0.0016 

0.0013 

0.9820 

0.0019 

237 

4 

4 

0.0137 

0.0015 

0.0013 

0.9813 

0.0022 

238 

4 

4 

0.0148 

0.0012 

0.0013 

0.9811 

0.0016 

239 

4 

4 

0.0051 

0.0010 

0.0013 

0.9916 

0.0010 

240 

4 

4 

0.0060 

0.0010 

0.0010 

0.9910 

0.0010 
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KREST :  Kalman  filter  Expert  SysTera. 
NFRMS :  240 
ITraj :  6 


#  Rule 

KR 

MAP 

PI 

P2 

P3 

P4 

P5 

1 

1 

1 

0.9600 

0.0100 

0.0100 

0.0100 

0.0100 

2 

1 

1 

0.9600 

0.0100 

0.0100 

0.0100 

0.0100 

3 

1 

1 

0.9605 

0.0092 

0.0100 

0.0103 

0.0099 

4 

1 

1 

0.9644 

0.0014 

0.0091 

0.0178 

0.0073 

5 

1 

1 

0.9046 

0.0040 

0.0140 

0.0676 

0.0098 

6 

1 

1 

0.8829 

0.0051 

0.0122 

0.0900 

0.0099 

7 

1 

1 

0.8849 

0.0014 

0.0082 

0.0967 

0.0087 

8 

1 

1 

0.8909 

0.0013 

0.0079 

0.0918 

0.0081 

9 

1 

1 

0.9001 

0.0010 

0.0077 

0.0841 

0.0071 

10 

1 

1 

0.9025 

0.0013 

0.0068 

0.0812 

0.0082 

11 

1 

1 

0.8835 

0.0010 

0.0070 

0.1001 

0.0084 

12 

1 

1 

0.8835 

0.0010 

0.0059 

0.1036 

0.0060 

13 

1 

1 

0.8625 

0.0010 

0.0053 

0.1255 

0.0057 

14 

1 

1 

0.8797 

0.0010 

0.0040 

0.1121 

0.0032 

15 

1 

1 

0.8957 

0.0010 

0.0039 

0.0964 

0.0030 

16 

1 

1 

0.8840 

0.0010 

0.0038 

0 . 1083 

0.0029 

17 

1 

1 

0 . 8948 

0.0010 

0.0039 

0.0979 

0.0024 

18 

1 

1 

0.9270 

0.0010 

0.0039 

0.0672 

0.0010 

19 

1 

1 

0.8661 

0.0010 

0.0025 

0.1294 

0.0010 

20 

1 

1 

0.9143 

0.0010 

0.0010 

0.0827 

0.0010 

21 

1 

1 

0.9020 

0.0010 

0.0010 

0.0949 

0.0011 

22 

1 

1 

0.9586 

6.0010 

0.0012 

0.0383 

0.0010 

23 

1 

1 

0.9668 

0.0010 

0.0010 

0.0302 

0.0010 

24 

1 

1 

0.9636 

0.0010 

0.0010 

0 . 0334 

0.0010 

25 

1 

1 

0.9634 

0.0010 

0.0010 

0.0336 

0.0010 

26 

1 

1 

0.7833 

0.0010 

0.0010 

0.2137 

0.0010 

27 

1 

1 

0.7072 

0.0010 

0.0010 

0.2898 

0.0010 

28 

1 

1 

0.8328 

0.0017 

0.0010 

0.1635 

0.0010 

29 

1 

1 

0.8499 

0.0010 

0.0010 

0.1471 

0.0010 

30 

1 

1 

0.8297 

0.0010 

0.0010 

0.1673 

0.0010 

31 

1 

1 

0.7769 

0.0010 

0.0010 

0.2201 

0.0010 

32 

1 

1 

0.7838 

0 .0010 

0.0010 

0.2132 

0.0010 

33 

1 

1 

0.7676 

0.0010 

0.0010 

0.2294 

0.0010 

34 

1 

1 

0.7818 

0.0010 

0.0010 

0.2152 

0.0010 

35  65 

1 

4 

0.3677 

0.0010 

0.0010 

0.6293 

0.0010 

f  1 
S  .V 

yy 

%V« 

yy 


36 

4 

4 

0.2524 

0.0010 

0.0010 

0.7446 

0.0010 

37 

4 

4 

0.0835 

0.0021 

0.0010 

0.9124 

0.0010 

38 

4 

4 

0.0918 

0.0018 

0.0012 

0.9043 

0.0010 

39 

4 

4 

0.0903 

0.0016 

0.0012 

0.9059 

0.0010 

40 

4 

4 

0.1073 

0.0010 

0.0010 

0.8896 

0.0010 

41 

4 

4 

0.1377 

0.0010 

0.0010 

0.8592 

0.0011 

42 

4 

4 

0 . 0449 

0.0010 

0.001C 

0.9521 

0.0010 

43 

4 

4 

0.0366 

0.0010 

0.0010 

0.9604 

0.0010 

44 

4 

4 

0.0422 

0.0011 

0.0010 

0.9544 

0.0012 

45 

4 

4 

0.0261 

0.0010 

0.0013 

0.9707 

0.0010 

46 

4 

4 

0.0267 

0.0010 

0.0010 

0.9703 

0.0010 

47 

4 

4 

0.0325 

0.0014 

0.0014 

0.9637 

0.0010 

48 

4 

4 

0.0286 

0.0010 

0.0010 

0.9684 

0.0010 

49 

4 

4 

0 . 0345 

0.0011 

0.0015 

0.9616 

0.0014 

50 

4 

4 

0 . 0040 

0.0010 

0.0010 

0.9930 

0.0010 

51 

4 

4 

0.0037 

0.0010 

0.0011 

0.9932 

'  0.0010 

52 

4 

4 

0.0052 

0.0010 

0.0010 

0.9918 

0.0010 

53 

4 

4 

0.0114 

0.0018 

0.0010 

0.9842 

0.0016 

54 

4 

4 

0.0242 

0.0026 

0.0016 

0.9687 

0.0029 

55 

4 

4 

0 . 0343 

0.0026 

0.0021 

0.9585 

0.0025 

56 

4 

4 

0.0365 

0 . 0040 

0.0035 

0.9515 

0 . 0044 

57 

4 

4 

0.0411 

0 . 0036 

0.0035 

0.9496 

0.0022 

58 

4 

4 

0.0393 

0 . 0038 

0 . 0046 

0.9498 

0.0025 

59 

4 

4 

0.0276 

0.0010 

0.0019 

0.9682 

0.0013 

60 

4 

4 

0.0086 

0.0010 

0.0010 

0 . 9884 

0.0010 

61 

4 

4 

0.0174 

0.0010 

0.0018 

0.9785 

0.0012 

62 

4 

4 

0.0181 

0.0012 

0.0019 

0.9774 

0.0014 

63 

4 

4 

0.0016 

0.1910 

0.0042 

0.7911 

0.0121 

64 

2 

2 

0.0010 

0.9633 

0.0091 

0.0037 

0.0229 

65 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 

66 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0 . 0010 

67 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 

68 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 

69 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 

70 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 

71 

2 

2 

0.0725 

0 . 9010 

0.0010 

0.0010 

0.0245 

72 

2 

2 

0.0143 

0.9825 

0.0010 

0.0012 

0.0010 

73 

1 

1 

0.5997 

0.0667 

0.0010 

0.0077 

0.3249 

74 

1 

1 

0.6298 

0.0343 

0.0010 

0.0051 

0.3299 

75 

1 

1 

0.6247 

0.0365 

0.0010 

o .  :c5i 

0.3328 

76 

1 

1 

0.6282 

0.0362 

0.0010 

o  :;55 

0  3290 
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77 

1 

1 

0.7124 

0.0129 

0.0010 

0.0074 

0.2664 

78 

1 

1 

0.7061 

0.0119 

0.0010 

0.0085 

0.2725 

79 

1 

1 

0.6938 

0.0127 

0.0010 

0.0086 

0.2839 

80 

1 

1 

0.7899 

0.0026 

0.0010 

0.0118 

0.1947 

81 

1 

1 

0.8115 

0.0010 

0.0010 

0.0122 

0.1744 

82 

1 

1 

0.8880 

0.0010 

0.0010 

0.0138 

0.0962 

83 

1 

1 

0.9081 

0.0010 

0.0010 

0.0135 

0.0764 

84 

1 

1 

0.9238 

0.0010 

0.0010 

0.0142 

0.0599 

85 

1 

1 

0.9383 

0.0010 

0.0010 

0.0145 

0.0452 

86 

1 

1 

0.9675 

0.0010 

0.0019 

0.0116 

0.0180 

87 

1 

1 

0.9801 

0.0010 

0.0010 

0.0152 

0.0027 

88 

1 

1 

0.9771 

0.0010 

0.0010 

0.0185 

0.0024 

89 

1 

1 

0.9588 

0.0022 

0.0010 

0.0351 

0.0029 

90 

1 

1 

0.9624 

0.0031 

0.0010 

0.0276 

0.0059 

91 

1 

1 

0 . 9436 

0.0078 

0.0010 

0.0330 

0.0145 

92 

1 

1 

0.9593 

0.0067 

0.0010 

0.0234 

0.0095 

93 

1 

1 

0.9532 

0.0103 

0.0011 

0.0193 

0.0162 

94 

1 

1 

0.4201 

0.0881 

0.0012 

0.2036 

0.2870 

95 

70 

1 

5 

0.3367 

0.0850 

0.0020 

0.2081 

0.3682 

96 

70 

1 

5 

0.3114 

0 . 0404 

0.0023 

0.0707 

0.5753 

97 

5 

5 

0.1421 

0.0692 

0.0027 

0 . 0345 

0.7516 

98 

5 

5 

0.0450 

0.2350 

0.0031 

0.0284 

0.6886 

99 

5 

5 

0.0058 

0.2710 

0.0020 

0.0059 

0.7153 

100 

5 

5 

0.0013 

0.2254 

0.0014 

0.0019 

0.7700 

101 

2 

2 

0.0010 

0.6581 

0.0010 

0.0029 

0.3371 

102 

2 

2 

0.0010 

0.9251 

0.0010 

0.0040 

0.0689 

103 

2 

2 

0.0010 

0.9952 

0.0010 

0.0010 

0.0018 

104 

2 

2 

0.0010 

0.9926 

0.0034 

0.0017 

0.0013 

105 

2 

2 

0.0010 

0.9955 

0.0015 

0.0010 

0.0010 

106 

2 

2 

0.0010 

0.9952 

0.0016 

0.0010 

0.0012 

107 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 

108 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 

109 

2 

2 

0.0010 

0.9957 

0.0013 

0.0010 

0.0010 

110 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 

111 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 

112 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 

113 

2 

2 

0.0010 

0.9934 

0.0019 

0.0010 

0.0027 

114 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 

115 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 

116 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 

117 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 

[  :r> 


118 

2 

2 

0.0010 

119 

2 

2 

0.0010 

120 

2 

2 

0.0010 

121 

2 

2 

0.0010 

122 

2 

2 

0.0010 

123 

2 

2 

0.0010 

124 

2 

2 

0.0010 

125 

2 

2 

0.0010 

126 

2 

2 

0.0010 

127 

2 

2 

0.0010 

128 

2 

2 

0.0010 

129 

2 

2 

0.0010 

130 

2 

2 

0.0010 

131 

2 

2 

0.0010 

132 

2 

2 

0.0010 

133 

2 

2 

0.0010 

134 

2 

2 

0.0010 

135 

2 

2 

0.0010 

136 

2 

2 

0.0010 

137 

2 

2 

0.0095 

138 

2 

2 

0.0373 

139 

2 

2 

0.0217 

140 

2 

2 

0.0010 

141 

2 

2 

0.0010 

142 

2 

2 

0.0010 

143 

2 

2 

0.0010 

144 

2 

2 

0.0010 

145 

2 

2 

0.0010 

146 

2 

2 

0.0010 

147 

2 

2 

0.0010 

148 

2 

2 

0.0014 

149 

2 

2 

0.0020 

150 

2 

2 

0.0014 

151 

2 

2 

0.0010 
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0.0010 

0.0010 
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2 

2 

0.0028 

0.9813 

119 

2 

2 

0.0010 

0.9867 

120 

2 

2 

0.0010 

0.9864 

121 

2 

2 

0.0010 

0.9912 

122 

2 

2 

0.0010 

0.9947 

123 

2 

2 

0.0010 

0.9960 

124 

2 

2 

0.0010 

0.9960 

125 

2 

2 

0.0010 

0.9960 

126 

2 

2 

0.0010 

0.9960 
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2 

2 

0.0010 

0.9955 
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2 

2 

0.0055 

0.9592 

129 

2 

2 

0.0010 

0.9931 

130 

2 

2 

0.0010 

0.9960 
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2 

2 

0.0010 

0.9960 
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2 

2 

0.0010 
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2 

2 

0.0010 

0.9960 
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2 

2 

0.0010 

0.9960 
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2 

2 

0.0010 

0.9960 
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2 

2 

0.0010 

0.9960 
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2 

2 

0.0013 

0.9936 
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2 

2 

0.0058 

0 . 9884 
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2 

2 

0.0010 

0.9957 
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2 

2 

0.0010 

0.9960 
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2 

2 

0.0010 

0 . 9960 
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2 

2 

0.0010 

0.9960 
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2 

2 

0.0010 

0.9960 
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2 

2 

0.0010 

0.9960 
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2 

2 

0.0010 

0.9960 
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2 

2 

0.0010 

0.9960 
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2 

2 

0.0023 

0.9934 

148 

2 

2 

0.0100 

0.9743 

149 

2 

2 

0.0100 

0 . 9744 

150 

2 

2 

0.0145 

0.9677 

151 

2 

2 

0.0246 

0.9468 

152 

2 

2 

0.0322 

0.9280 

153 

2 

2 

0.0357 

0.9245 
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2 

2 

0 . 0477 

0.9081 
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2 

2 

C . 0586 

0.8947 
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2 

2 

0.0834 
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2 

2 

0.0934 

0.8471 
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2 

2 

0.0948 
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0.0010 

0.0112 

0.0163 

0.0010 

0.0180 

0.0208 

0.0010 

0.0190 

0.0198 

0.0021 

0.0233 

0.0188 

0.0010 

0.0015 

0.0296 

0.0372 

0.0161 

0.0209 
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4 

0.0015 

0.0342 

0.0237 

4 

0.0017 

0.0290 

0 . 0239 
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160 
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165 

166 

167 

168 
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186 
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188 

189 

190 

191 

192 
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2 

2 

0 . 1349 

0.7948 

2 

2 

0.1190 

0.8313 

2 

2 

0.0852 

0.8717 

2 

2 

0 . 0487 

0.9231 

2 

2 

0.0594 

0.9113 

2 

2 

0.2221 

0.7209 

2 

2 

0.2254 

0.7173 

2 

2 

0.2756 

0.6704 

2 

2 

0.2379 

0.6948 

2 

2 

0.1922 

0.7538 

2 

2 

0.1825 

0.7564 

2 

2 

0.1840 

0.7568 

2 

2 

0.0191 

0.9249 

2 

2 

0.1184 

0.6112 

2 

2 

0.2278 

0.4931 

2 

2 

0.2966 

0.4366 

2 

2 

0.3397 

0.4029 

1 

1 

0.4184 

0.3313 

2 

2 

0.3053 

0.4281 

2 

2 

0.3087 

0.3969 

1 

1 

0.3874 

0.2561 

1 

1 

0.3443 

0.2287 

1 

1 

0.3831 

0.1791 

1 

1 

0.4693 

0 . 0848 

1 

1 

0.5193 

0.0746 

1 

1 

0.5722 

0.0576 

1 

1 

0.4382 

0.1031 

1 

1 

0.4019 

0.3028 

1 

1 

0.5008 

0.2339 

1 

1 

0.6056 

0.1083 

1 

1 

0.5034 

0.1444 

1 

1 

0.6207 

0.0886 

1 

1 

0.6095 

0.1128 

1 

1 

0.5138 

0.1516 

1 

1 

0.4319 

0.1915 

1 

1 

0.4813 

0.1599 

1 

1 

0.5681 

0.1297 

1 

1 

0.5469 

0.2071 

1 

1 

0.6787 

0.1277 

1 

1 

0.7725 

0.0662 

1 

1 

0.8019 

0.0509 

0.0015 

0 . 0477 

0.0211 

0.0010 

0.0335 

0.0151 

0.0010 

0.0273 

0.0148 

0.0010 

0.0186 

0.0086 

0.0010 

0.0203 

0 . 0080 

0.0019 

0.0345 

0.0205 

0.0017 

0.0417 

0.0138 

0.0016 

0 . 0343 

0.0181 

0.0019 

0.0397 

0.0257 

0.0020 

0.0163 

0 . 0357 

0.0021 

0.0172 

0.0419 

0.0023 

0.0155 

0.0414 

0.0011 

0.0132 

0 . 0411 

0 . 0034 

0.0278 

0.2393 

0 . 0040 

0.0431 

0.2319 

0.0035 

0 . 0374 

0.2259 

0.0038 

0.0435 

0.2101 

0.0057 

0.0629 

0.1817 

0.0059 

0 . 0974 

0.1633 

0.0085 

0.1472 

0 . 1387 

0.0122 

0.1862 

0.1581 

0.0083 

0.0775 

0.3412 

0.0097 

0.0941 

0 . 3340 

0.0083 

0 . 0848 

0.3528 

0.0074 

0.0691 

0.3297 

0.0067 

0.0627 

0.3007 

0.0064 

0.0556 

0.3966 

0.0058 

0.1267 

0.1629 

0.0051 

0.1086 

0.1516 

0.0058 

0.1034 

0.1720 

0.0085 

0.2705 

0.0732 

0.0069 

0.2082 

0.0756 

0.0052 

0.1233 

0 . 1492 

0.0060 

0.0694 

0.2592 

0.0068 

0.1073 

0.2624 

0.0059 

0.1125 

0 . 2404 

0.0049 

0.0901 

0.2072 

0.0069 

0. 1610 

0.0781 
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0.0039 

0.0746 

0.0828 

0.0035 

0.0681 

0 . 0756 
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200 

1 

1 

0.7240 

0.0418 

0.0017 

0.0817 

0.1508 

201 

1 

1 

0.7803 

0 . 0234 

0.0018 

0.0768 

0.1177 

MX 

202 

1 

1 

0.8264 

0.0145 

0.0015 

0.0592 

0.0984 

m 

203 

1 

1 

0.8533 

0.0098 

0.0013 

0.0456 

0.0901 

204 

1 

1 

0.8699 

0.0095 

0.0012 

0.0534 

0.0660 

205 

1 

1 

0.8608 

0.0088 

0.0010 

0.0624 

0.0670 

206 

1 

1 

0.8812 

0.0073 

0.0010 

0.0594 

0.0510 

207 

1 

1 

0.9027 

0.0059 

0.0010 

0.0455 

0 . 0449 

208 

1 

1 

0.9174 

0.0043 

0.0010 

0.0394 

0.0380 

209 

1 

1 

0.9135 

0.0032 

0.0010 

0.0213 

0.0609 

210 

1 

1 

0.9303 

0.0016 

0.0010 

0.0147 

0.0524 
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1 

1 

0.9466 

0.0013 

0.0010 

0.0131 

0.0381 
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1 

1 

0.9442 

0.0010 

0.0010 

0.0134 

0 . 0404 

213 

1 

1 

0.9541 

0.0010 

0.0010 

0.0097 

0 . 0342 

214 

1 

1 

0.9575 

0.0010 

0.0010 

0.0081 

0 . 0324 
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1 

1 

0.9601 

0.0010 

0.0010 

0.0098 

0.0282 
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1 

1 

0.9698 

0.0010 

0.0010 

0.0066 

0.0216 
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1 

1 

0.9769 

0.0010 

0.0010 

0.0054 

0.0157 
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218 

1 

1 

0.9326 

0.0022 

0.0020 

0.0053 

0.0579 
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1 

1 

0.9757 

0.0010 

0.0011 

0.0050 

0.0171 
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1 

1 

0.9836 

0.0010 

0.0010 

0 . 0042 

0.0102 
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1 

1 
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1 

1 

0.9794 

0.0018 
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1 

1 

0.9873 

0.0010 

0.0010 

0.0015 

0.0092 

225 

1 

1 

0.9891 

0.0010 

0.0010 

0.0011 

0.0078 
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1 

1 

0.9833 

0.0010 

0.0010 

0.0010 

0.0137 

• 
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1 

1 

0.9852 

0.0010 

0.0010 

0.0010 

0.0118 

r 
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1 

1 

0.9915 

0.0010 

0.0010 

0.0010 

0.0055 
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1 

1 
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0.0035 
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1 

1 

0.9850 

0.0102 
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0.0021 
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1 

1 

0.9920 

0.0041 
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1 

1 

0.9952 

0.0016 

0.0010 

0.0010 
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1 

1 

0.9959 

0.0011 

0.0010 

0.0010 

0.0010 
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1 

1 

0.9960 

0.0010 

0.0010 

0.0010 

0.0010 

’ 

236 

1 

1 

0.9960 

0.0010 

0.0010 

0.0010 

0.0010 

• 

237 

1 

1 

0.9951 
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0.0013 

0.0010 

0.0016 
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1 

1 

0.9956 
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0.0012 
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1 

1 

0.9957 
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:  Kalman 

filter 

Expert  SysTem. 

NFRMS :  240 
ITraj  :  8 

#  Rule 

KR 

MAP 

PI 

P2 

P3 

P4 

P5 

1 

1 

1 

0.9600 

0.0100 

0.0100 

0.0100 

0.0100 

2 

1 

1 

0.9600 

0.0100 

0.0100 

0.0100 

0.0100 

3 

1 

1 

0.9602 

0.0097 

0.0099 

0.0098 

0.0103 

4 

1 

1 

0.9546 

0.0068 

0.0092 

0.0068 

0.0226 

5 

1 

1 

0.9762 

0.0014 

0.0113 

0.0010 

0.0101 

6 

1 

1 

0.9765 

0.0010 

0.0111 

0.0010 

0.0104 

7 

1 

1 

0.9742 

0.0010 

0.0103 

0.0012 

0.0134 

8 

1 

1 

0.9744 

0.0010 

0.0101 

0.0011 

0.0135 

9 

1 

1 

0.9677 

0.0010 

0.0103 

0.0011 

0.0199 

10 

1 

1 

0.9646 

0.0010 

0.0080 

0.0010 

0.0254 

11 

1 

1 

0 . 9644 

0.0010 

0.0079 

0.0010 

0.0257 

12 

1 

1 

0.9614 

0.0010 

0.0073 

0.0012 

0.0291 

13 

1 

1 

0.9566 

0.0012 

0.0066 

0.0013 

0 . 0343 

14 

1 

1 

0.9731 

0.0010 

0.0073 

0.0013 

0.0173 

15 

1 

1 

0.9602 

0.0025 

0.0111 

0.0019 

0.0244 

16 

1 

1 

0.9371 

0.0081 

0.0208 

0.0074 

0.0266 

17 

1 

1 

0.6666 

0 . 0974 

0.0956 

0.0963 

0.0441 

18 

1 

1 

0.7800 

0.0197 

0.1138 

0.0158 

0.0707 

19 

3 

3 

0.2955 

0 . 0668 

0.4880 

0.1305 

0.0192 

20 

1 

1 

0.6512 

0.0199 

0.2002 

0.0699 

0.0588 

21 

1 

1 

0.5027 

0.0205 

0.3637 

0.0765 

0.0366 

22 

3 

3 

0.2686 

0 . 0457 

0.5750 

0.0766 

0.0341 

23 

3 

3 

0.2218 

0 . 0486 

0.6124 

0.0789 

0.0383 

24 

3 

3 

0.2802 

0 . 0378 

0 . 5747 

0.0775 

0.0298 

25 

40 

1 

3 

0.3437 

0.0222 

0.5254 

0.0770 

0.0318 

26 

3 

3 

0.0633 

0.0395 

0.7546 

0.1335 

0.0091 

27 

3 

3 

0.1548 

0.0163 

0.7160 

0.0954 

0.0176 

28 

40 

1 

3 

0.3365 

0.0120 

0.5416 

0.0602 

0.0496 

29 

40 

1 

3 

0.3920 

0.0058 

0.4872 

0.0579 

0.0571 

30 

3 

3 

0.3294 

0.0016 

0.5696 

0.0398 

0.0596 

31 

40 

1 

3 

0.3705 

0.0018 

0.4979 

0.0381 

0.0917 

32 

40 

1 

3 

0.3723 

0.0014 

0.4516 

0.0264 

0.1483 

33 

3 

3 

0.3624 

0.0010 

0.4979 

0.0177 

0.1209 

34 

40 

1 

3 

0 . 3783 

0.0010 

0.4809 

0.0141 

0.1256 

35 

3 

3 

0.2456 

0.0048 

0.6813 

0.0082 

0.0601 

36 

40 

1 

3 

0.4119 

0.0010 

C .5149 

0.0010 

0.0712 

37 

3 

3 

0.3481 

0.0033 

0.4622 

0.0014 

0.1850 

38 

40 

1 

3 

0.3697 

0.0031 

0.4835 

0.0010 

0.1427 

39 

40 

1 

3 

0.3813 

0.0015 

0.4750 

0.0010 

0.1412 

40 

1 

1 

0.4706 

0.0010 

0.3663 

0.0010 

0.1610 

41 

1 

1 

0.5118 

0.0010 

0.2685 

0.0010 

0.2178 

42 

1 

1 

0.5231 

0.0010 

0.2657 

0.0010 

0.2092 

43 

1 

1 

0.5790 

0.0010 

0.1673 

0.0010 

0.2517 

44 

1 

1 

0.6508 

0.0010 

0 . 1443 

0.0010 

0.2029 

45 

1 

1 

0.5988 

0.0010 

0.2331 

0.0010 

0.1662 

46 

1 

1 

0.6655 

0.0010 

0.1837 

0.0010 

0.1488 

47 

1 

1 

0.5952 

0.0016 

0.2332 

0.0010 

0.1690 

48 

1 

1 

0.6321 

0.0010 

0.2000 

0.0011 

0.1657 

49 

1 

1 

0.5208 

0.0011 

0.2691 

0.0010 

0.2080 

50 

3 

3 

0.4007 

0.0021 

0.4202 

0.0021 

0.1750 

51 

3 

3 

0.3689 

0.0018 

0.4580 

0.0010 

0.1703 

52 

1 

1 

0.4912 

0.0010 

0.2799 

0.0010 

0.2269 

53 

1 

1 

0 . 6037 

0.0010 

0.1228 

0.0010 

0.2715 

54 

1 

1 

0.5810 

0.0011 

0.1324 

0.0010 

0 . 2844 

55 

70 

1 

5 

0.3839 

0.0010 

0.1149 

0.0010 

0.4992 

56 

70 

1 

5 

0.2542 

0.0010 

0.1618 

0.0010 

0.5820 

57 

70 

1 

5 

0.2671 

0.0010 

0.1309 

0.0011 

0.5999 

58 

70 

1 

5 

0.2665 

0.0010 

0.1517 

0.0010 

0.5797 

59 

5 

5 

0.2718 

0.0010 

0 . 0743 

0.0010 

0.6519 

60 

70 

1 

5 

0.2991 

0.0010 

0.1072 

0.0010 

0.5917 

61 

25 

1 

5 

0 . 3240 

0.0011 

0.0725 

0.0010 

0.6014 

62 

5 

5 

0.2312 

0.0010 

0.0360 

0.0010 

0.7308 

63 

5 

5 

0 . 0497 

0.0078 

0.0689  ’ 

0.0031 

0.8706 

64 

3 

3 

0.0010 

0.1181 

0.8263 

0.0320 

0.0226 

65 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 

66 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 

67 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 

68 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 

69 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 

70 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 

71 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 

72 

2 

2 

0.0230 

0.9698 

0.0010 

0.0045 

0.0018 

73 

2 

2 

0.0061 

0.9900 

0.0010 

0.0010 

0.0020 

74 

2 

2 

0.0333 

0.9590 

0.0010 

0.0023 

0 . 0044 

75 

2 

2 

0.0988 

0.8837 

0.0010 

0.0022 

0.0142 

76 

2 

2 

0.1089 

0.8727 

0.0010 

0.0033 

0.0141 
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77 

2 

2 

0.2318 

0.7392 

0.0010 

0.0048 

0.0233 

78 

I. 

2 

0.2733 

0.7024 

0.0010 

0.0027 

0.0206 

79 

2 

2 

0.4346 

0.5243 

0.0010 

0.0052 

0.0349 

80 

1 

1 

0.6093 

0.3410 

0.0010 

0.0064 

0 . 0424 

81 

1 

1 

0  r233 

0.2139 

0.0010 

0.0090 

0.0529 

82 

1 

1 

0.8653 

0.0555 

0.0010 

0.0075 

0.0707 

83 

1 

1 

0.8663 

0.0175 

0.0017 

0.0054 

0.1092 

84 

1 

1 

0.8382 

0.0022 

0.0010 

0.0038 

0.1549 

85 

1 

1 

0.8708 

0.0012 

0.0010 

0.0049 

0.1220 

86 

1 

1 

0.7662 

0.0010 

0.0010 

0.0010 

0.2308 

87 

1 

1 

0.7894 

0.0010 

0.0010 

0.0010 

0.2076 

88 

1 

1 

0.7156 

0.0010 

0.0010 

0.0010 

0.2814 

89 

1 

1 

0.6715 

0.0015 

0.0010 

0.0012 

0.3248 

90 

1 

1 

0.7441 

0.0017 

0.0010 

0.0014 

0.2517 

91 

1 

1 

0.7037 

0.0026 

0.0010 

0.0043 

0 . 2884 

92 

1 

1 

0.7309 

0.0030 

0.0010 

0.0035 

0.2616 

93 

1 

1 

0 . 6778 

0.0099 

0.0011 

0.0155 

0.2957 

94 

1 

1 

0.7595 

0.0010 

0.0010 

0.0010 

0 . 2375 

95 

1 

1 

0.7776 

0.0010 

0.0010 

0.0010 

0.2194 

96 

1 

1 

0.7790 

0.0198 

0.0010 

0.0267 

0.1736 

97 

1 

1 

0.5160 

0.1012 

0.0016 

0.1656 

0.2156 

98 

1 

1 

0.3588 

0.1812 

0.0024 

0.1574 

0.3002 

99 

2 

2 

0.0699 

0.4300 

0.0012 

0.3151 

0.1837 

100 

2 

2 

0.0071 

0.7272 

0.0010 

0.2428 

0.0218 

101 

2 

2 

0.0010 

0.9342 

0.0010 

0 . 0499 

0.0139 

102 

2 

2 

0.0010 

0.9923 

0.0010 

0.0026 

0.0031 

103 

2 

2 

0.0312 

0.7040 

C .0194 

0.0015 

0 . 2440 

104 

2 

2 

0.0015 

0.4948 

0.0184 

0.0010 

0 . 4843 

105 

2 

2 

0.0010 

0.8041 

0.0190 

0.0010 

0.1749 

106 

2 

2 

0.0010 

0.9793 

0.0050 

0.0010 

0.0138 

107 

2 

2 

0.0010 

0.9936 

0.0028 

0.0010 

0.0016 

108 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 

109 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 

110 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 

111 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 

112 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 

113 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0 . 0010 

114 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 

115 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 

116 

2 

2 

0.0010 

0.9959 

0.0011 

0.0010 

0 . 0010 

117 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 
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118 

2 

2 

0.0028 

0.9813 

0.0057 

0.0012 

0.0090 

119 

2 

2 

0.0010 

0.9867 

0.0066 

0.0010 

0 . 0047 

120 

2 

2 

0.0010 

0.9864 

0.0095 

0.0012 

0.0019 

121 

2 

2 

0.0010 

0.9912 

0.0056 

0.0010 

0.0012 

122 

2 

2 

0.0010 

0.9947 

0.0023 

0.0010 

0.0010 

123 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 

124 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 

125 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 

126 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 

127 

2 

2 

0.0010 

0.9955 

0.0013 

0.0012 

0.0010 

128 

2 

2 

0.0055 

0.9592 

0.0184 

0.0015 

0.0155 

129 

2 

2 

0.0010 

0.9931 

0.0033 

0.0016 

0.0010 

130 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 

131 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 

132 

2 

2 

0.0010 

0.9956 

0.0010 

0.0014 

0.0010 

133 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 

134 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 

135 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 

136 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 

137 

2 

2 

0.0016 

0.9929 

0.0023 

0.0016 

0.0016 

138 

2 

2 

0.0034 

0.9911 

0.0020 

0.0012 

0.0023 

139 

2 

2 

0.0010 

0.9896 

0.0010 

0.0013 

0.0071 

140 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 

141 

2 

2 

0.0010 

0 . 9960 

0.0010 

0.0010 

0.0010 

142 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 

143 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 

144 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 

145 

2 

2 

0.0010 

0.9960 

0.0010 

0.0010 

0.0010 

146 

2 

2 

0.0057 

0.9908 

0.0010 

0.0016 

0.0010 

147 

2 

2 

0.0081 

0.9878 

0.0010 

0.0021 

0.0010 

148 

2 

2 

0.0300 

0.9601 

0.0010 

0 . 0044 

0 . 0045 

149 

2 

2 

0.0263 

0.9639 

0.0010 

0.0043 

0.0044 

150 

2 

2 

0.0321 

0.9575 

0.0010 

0.0045 

0.0049 

151 

2 

2 

0.0641 

0.9174 

0.0010 

0.0080 

0.0095 

152 

2 

2 

0.0419 

0.9441 

0.0010 

0.0056 

0.0074 

153 

2 

2 

0.0466 

0.9391 

0.0010 

0.0058 

0.0074 

154 

2 

2 

0.0315 

0.9586 

0.0012 

0.0031 

0.0055 

155 

2 

2 

0.0264 

0.9672 

0.0010 

0.0024 

0.0030 

156 

2 

2 

0.0378 

0.9534 

0.0014 

0.0038 

0.0036 

157 

2 

2 

0.0402 

0.9507 

0.0015 

0.0034 

0.0042 

158 

2 

2 

0.0355 

0.9562 

0.0014 

0.0035 

0.0034 

1  .->() 


159 

160 
161 
162 

163 

164 

165 

166 

167 

168 

169 

170 

171 

172 

173 

174 

175 

176 

177 

178 

179 

180 
181 
182 

183 

184 

185 

186 

187 

188 

189 

190 

191 

192 

193 

194 

195 

196 

197 

198 

199 


2 

2 

0.0547 

0 . 9349 

2 

2 

0.0374 

0.9560 

2 

2 

0.0461 

0.9463 

2 

2 

0.0089 

0.9858 

2 

2 

0.0119 

0.9823 

2 

2 

0 . 0479 

0.9395 

2 

2 

0.0682 

0.9130 

2 

2 

0.0736 

0.9027 

2 

2 

0.0719 

0.9078 

2 

2 

0.1368 

0.8346 

2 

2 

0 . 1548 

0.8141 

2 

2 

0.1765 

0.7892 

2 

2 

0.0124 

0.9698 

2 

2 

0.1024 

0.8327 

2 

2 

0.2235 

0.6801 

2 

2 

0.2824 

0.6124 

2 

2 

0.3446 

0.5425 

1 

1 

0.5298 

0.3454 

1 

1 

0.4691 

0.3796 

2 

2 

0.4039 

0.4233 

1 

1 

0.5305 

0 . 2796 

1 

1 

0.4724 

0.3730 

1 

1 

0.4955 

0.3198 

1 

1 

0.6438 

0 . 1943 

1 

1 

0.6724 

0.1574 

1 

1 

0.7321 

0.1228 

1 

1 

0.6517 

0.1911 

1 

1 

0.5100 

0.3522 

1 

1 

0.6030 

0.2640 

1 

1 

0.6391 

0.1760 

1 

1 

0.4717 

0.2072 

1 

1 

0.6201 

0.1293 

1 

1 

0.6548 

0.1284 

1 

1 

0.6109 

0.2255 

1 

1 

0.3943 

0.3575 

1 

1 

0.4275 

0.3023 

1 

1 

0.5606 

0.2284 

1 

1 

0.3855 

0.3148 

1 

1 

0.5163 

0.3216 

1 

1 

0.6494 

0.2118 

1 

1 

0.7000 

0.1758 

0.0015 

0.0057 

0.0032 

0.0010 

0.0035 

0.0021 

0.0011 

0.0036 

0.0029 

0.0010 

0.0029 

0.0014 

0.0010 

0.0032 

0.0015 

0.0024 

0.0069 

0.0033 

0.0028 

0.0120 

0 . 0040 

0.0037 

0.0142 

0.0058 

0.0035 

0.0119 

0 . 0048 

0.0072 

0.0124 

0.0090 

0.0083 

0.0124 

0.0105 

0.0099 

0.0142 

0.0101 

0.0024 

0.0121 

0.0033 

0.0075 

0.0367 

0.0208 

0.0097 

0.0629 

0 . 0238 

0 . 0073 

0 . 0730 

0.0249 

0.0074 

0.0813 

0 . 0243 

0.0123 

0 . 0849 

0.0277 

0.0133 

0. 1141 

0.0239 

0.0151 

0.1426 

0.0151 

0.0197 

0.1522 

0.0180 

0.0087 

0.0975 

0 . 0484 

0.0087 

0.1229 

0.0530 

0.0063 

0.0977 

0.0579 

0.0051 

0.0990 

0.0661 

0.0045 

0.0857 

0.0550 

0.0053 

0.0994 

0.0524 

0.0043 

0.1086 

0.0248 

0 . 0043 

0.1043 

0.0244 

0.0060 

0.1491 

0.0298 

0.0082 

0.3052 

0 . 0077 

0.0076 

0.2355 

0 . 0074 

0.0057 

0.1992 

0.0119 

0.0082 

0.1356 

0.0198 

0.0093 

0.2295 

0.0094 

0.0088 

0.2530 

0 . 0084 

0.0066 

0.1977 

0.0068 

0.0083 

0.2888 

0.0026 

0.0090 

0.  1482 

0.0050 

0 . 0073 

0.1258 

0.0056 

0.0071 

0. 1116 

0.0055 

200 

201 

202 

203 

204 

205 

206 

207 

208 

209 

210 
211 
212 

213 

214 

215 

216 

217 

218 

219 

220 
221 
222 

223 

224 

225 

226 

227 

228 

229 

230 

231 

232 

233 

234 

235 

236 

237 

238 

239 

240 


1 

1 

0.7916 

0.1137 

0.0055 

0.0810 

0.0081 

1 

1 

0.8541 

0.0491 

0.0044 

0.0881 

0 . 0043 

1 

1 

0.8882 

0.0275 

0.0040 

0.0768 

0.0036 

1 

1 

0.9314 

0.0199 

0.0034 

0.0417 

0.0036 

1 

1 

0.9387 

0.0168 

0.0032 

0.0382 

0.0031 

1 

1 

0.9466 

0.0124 

0.0026 

0.0356 

0.0027 

1 

1 

0.9577 

0.0116 

0.0022 

0.0258 

0.0028 

1 

1 

0.9646 

0.0110 

0.0020 

0.0198 

0.0028 

1 

1 

0.9710 

0.0080 

0.0016 

0.0169 

0.0025 

1 

1 

0.9709 

0.0068 

0.0020 

0.0177 

0.0026 

1 

1 

0.9786 

0.0033 

0.0016 

0.0145 

0.0019 

1 

1 

0 . 9848 

0.0023 

0.0012 

0.0103 

0.0015 

1 

1 

0.9827 

0.0014 

0.0011 

0.0137 

0.0011 

1 

1 

0.9857 

0.0010 

0.0010 

0.0113 

0.0010 

1 

1 

0.9892 

0.0010 

0.0010 

0.0078 

0.0010 

1 

1 

0.9876 

0.0010 

0.0010 

0.0094 

0.0010 

1 

1 

0.9908 

0.0010 

0.0010 

0.0062 

0.0010 

1 

1 

0.9920 

0.0010 

0.0010 

0.0050 

0.0010 

1 

1 

0.9889 

0.0017 

0.0020 

0.0049 

0.0025 

1 

1 

0.9926 

0.0010 

0.0011 

0 . 0043 

0.0010 

1 

1 

0.9948 

0.0010 

0.0010 

0.0022 

0.0010 

1 

1 

0.9925 

0.0010 

0.0010 

0.0045 

0.0010 

1 

1 

0.9936 

0.0010 

0.0010 

0.0034 

0.0010 

1 

1 

0.9931 

0.0013 

0.0013 

0.0032 

0.0012 

1 

1 

0.9951 

0.0010 

0.0010 

0.0019 

0.0010 

1 

1 

0.9950 

0.0010 

0.0010 

0.0020 

0.0010 

1 

1 

0.9937 

0.0010 

0.0011 

0.0020 

0.0021 

1 

1 

0.9945 

0.0010 

0.0010 

0.0016 

0.0019 

1 

1 

0.9959 

0.0010 

0.0010 

0.0011 

0.0010 

1 

1 

0.9960 

0.0010 

0.0010 

0.0011 

0.0010 

1 

1 

0.9884 

0.0073 

0.0018 

0.0015 

0.0010 

1 

1 

0.9900 

0.0056 

0.0021 

0.0013 

0.0010 

1 

1 

0.9936 

0.0027 

0.0016 

0.0011 

0.0010 

1 

1 

0.9960 

0.0010 

0.0010 

0.0010 

0.0010 

1 

1 

0.9960 

0.0010 

0.0010 

0.0010 

0.0010 

1 

1 

0.9960 

0.0010 

0.0010 

0.0010 

0.0010 

1 

1 

0.9960 

0.0010 

0.0010 

0.0010 

0.0010 

1 

1 

0.9960 

0.0010 

0.0010 

0.0010 

0.0010 

1 

1 

0.9960 

0.0010 

0.0010 

0.0010 

0.0010 

1 

1 

0.9952 

0.0010 

J .  0018 

0.0010 

0.0010 

1 

1 

0.9958 

0.0010 

0.0013 

0.0010 

0.0010 

7® 

&a 
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KREST :  Kalman  filter  Expert  SysTem. 
NFRMS :  240 
ITraj :  9 


«  Rule 

KR 

MAP 

PI 

P2 

P3 

P4 

P5 

1 

1 

1 

0.9600 

0.0100 

0.0100 

0.0100 

0.0100 

2 

1 

1 

0.9600 

0.0100 

0.0100 

0.0100 

0.0100 

3 

1 

1 

0.9606 

0.0096 

0.0098 

0.0101 

0.0099 

4 

1 

1 

0.9654 

0.0037 

0.0076 

0.0113 

0.0121 

5 

1 

1 

0.9698 

0.0034 

0.0078 

0.0067 

0.0123 

6 

1 

1 

0.9701 

0.0034 

0.0074 

0.0065 

0.0126 

7 

1 

1 

0.9661 

0.0045 

0.0068 

0.0091 

0.0135 

8 

1 

1 

0.9664 

0.0041 

0.0073 

0.0092 

0.0131 

9 

1 

1 

0.9713 

0.0041 

0.0079 

0.0076 

0.0092 

10 

1 

1 

0.9785 

0.0029 

0.0065 

0.0047 

0.0074 

11 

1 

1 

0.9810 

0.0020 

0.0062 

0.0042 

0.0066 

12 

1 

1 

0 . 9840 

0.0016 

0.0057 

0.0037 

0.0050 

13 

1 

1 

0.9814 

0.0014 

0.0056 

0.0051 

0.0065 

14 

1 

1 

0.9840 

0.0010 

0.0040 

0.0060 

0.0050 

15 

1 

1 

0.9729 

0 . 0035 

0.0065 

0.0143 

0.0028 

16 

1 

1 

0 . 9443 

0 . 0048 

0.0127 

0.0349 

0.0033 

17 

1 

1 

0 . 8549 

0.0104 

0.0314 

0.1014 

0.0019 

18 

1 

1 

0.9623 

0 . 0048 

0.0144 

0.0163 

0.0023 

19 

1 

1 

0.5690 

0.1537 

0.0617 

0.2109 

0 . 0047 

20 

1 

1 

0.8559 

0 . 0454 

0.0246 

0.0680 

0 . 006  j. 

21 

1 

1 

0.7071 

0.0907 

0.0463 

0 . 1482 

0.0078 

22 

1 

1 

0.4801 

0.3525 

0.0765 

0.0855 

0.0053 

23 

1 

1 

0.5734 

0.2678 

0.0715 

0.0840 

0.0033 

24 

1 

1 

0.6592 

0.1965 

0.0615 

0.0799 

0.0029 

25 

1 

1 

0.7312 

0.1511 

0.0509 

0 . 0644 

0.0025 

26 

1 

1 

0 . 4846 

0.2183 

0.1197 

0.1763 

0.0010 

27 

1 

1 

0.6825 

0.1060 

0.0843 

0.1261 

0.0011 

28 

1 

1 

0.8209 

0.0817 

0.0306 

0.0657 

0.0010 

29 

1 

1 

0 . 8434 

0.0717 

0.0288 

0.0551 

0.0010 

30 

1 

1 

0.8353 

0.0707 

0.0358 

0.0572 

0.0010 

31 

1 

1 

0.8919 

0.0244 

0.0330 

0.0497 

0.0010 

32 

1 

1 

0.9225 

0.0120 

0.0276 

0.0368 

0.0010 

33 

1 

1 

0.9234 

0.0094 

0.0289 

0.0373 

0.0010 

34 

1 

1 

0.9379 

0.0067 

f' .  0251 

0.0294 

0.0010 

35 

1 

1 

0.8928 

0.0044 

0.0501 

0.0517 

0.0010 

vv 


36 

1 

1 

0.9729 

0.0011 

0.0172 

0.0078 

0.0010 

37 

1 

1 

0.9616 

0.0010 

0.0207 

0.0157 

0.0010 

38 

1 

1 

0.9632 

0.0010 

0.0196 

0.0153 

0.0010 

39 

1 

1 

0.9661 

0.0010 

0.0182 

0.0138 

0.0010 

40 

1 

1 

0.9756 

0.0010 

0.0143 

0.0081 

0.0010 

41 

1 

1 

0.9833 

0.0010 

0.0102 

0.0045 

0.0010 

42 

1 

1 

0 . 9784 

0.0017 

0.0118 

0.0070 

0.0010 

43 

1 

1 

0.9845 

0.0018 

0.0079 

0.0048 

0.0010 

44 

1 

1 

0.9848 

0.0010 

0.0067 
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Appendix  H.  KREST  Expert  Rules 


********************************************************* 


k 


L 


Kalman  Filter  Residual  Expert  Rules 

(POC  -  Probability  of  Correctness) 

********************************************************* 

If  the  best  filter  is  in  the  X-  or  Y-direction  and  there 
is  significant  POC  associated  with  the  narrow  filter  and 
that  POC  level  is  rising,  then  go  with  the  narrow  filter. 

IF  Best=4  or  5  and  PI  >  0.3  and 

PI  is  increasing.  THEN  Goto  1 


(p  Rule25 

(Best  “val  <<45  >>) 

(PI  “val  >  0.3) 
(Pi-Increasing  “val  t) 
-(KREST-Best) 

— > 

(make  KREST-Best  ‘val  l) 
(make  Rule  “val  25) 


;  ************************************************************* 

;  If  the  best  filter  has  been  the  medium  maneuver/narrow  view 
;  view  filter  for  a  while  and  the  new  best  filter  is  the  wide 
;  view  filter,  but  the  wide  view  filter's  POC  level  isn't  too 
;  large  and  the  narrow  filter's  POC  level  isn't  too  small, 

;  stick  with  the  medium  maneuver/narrow  view  filter. 

;  IF  Best=3  for  last  3  or  more  and  the 

;  new  Best=2  and  P2  <  0.7  and  P3  >  0.2  THEN  Stay  3 

(p  Rule30 

(Last3  “val  3) 

(Best  “val  2) 

(P2  ‘val  <  0.7) 

(P3  “val  >  0.2) 

-(KREST-Best) 


(make  KREST-Best  ‘val  3) 
(make  Rule  ‘val  30) 


************************************************************ 
If  there  is  confusion  over  whether  the  X-direction  or 
Y-direction  filter  can  do  a  better  job,  and  there  is 
sufficient  POC  associated  with  the  narrow  view  filter, 
then  go  with  that  narrow  view  filter. 


IF  P4  >  0.25  and  P5  >  0.25  and  PI  >  0.18 


THEN  Goto  1 


(p  Rule35 

(P4  ‘val  >  0.25) 

(P5  “val  >  0.25) 

(PI  ‘val  >  0.18) 
-(KREST-Best) 

— > 

(make  KREST-Best  "val 
(make  Rule  “val 


********************************************************** 
If  the  medium  manuever/narrow  view  filter  is  the  best , 
but  the  no  manuever/narrow  view  filter  has  a  high  enough 
POC  level  and  that  POC  level  is  increasing,  then  go  with 
the  no  manuever/narrow  view  filter. 


;  IF  Best=3  and  PI  >  (P3  *  0.5)  and 
;  PI  is  increasing. 

(p  Rule40 

(Best  ‘val  3) 

(Pl-Is-Greater-Than-Half-0f-P3  'val  t) 
(Pi-Increasing  “val  t) 

-(KREST-Best) 

— > 

(make  KREST-Best  "val  1) 

(make  Rule  ‘val  40) 


THEN  Goto  1 


;******************************************************* 
If  the  no  manuever/narrow  view  filter  has  been  the 


lAtscs 


best  for  a  while  and  suddenly  the  medium  manuever/narrow 
view  and  Y-direction  filters  have  large  POC  levels,  then 
go  to  the  wide  view  filter. 


THEN  Goto  2 


;  IF  Best=l  for  last  4  and  P3  >  0.2 
;  and  P5  >  0.4 

(p  Rule45 

(Last4  “val  1) 

(P3  "val  >0.2) 

(P5  “val  >0.4) 

-(KREST-Best) 

--> 

(make  KREST-Best  "val  2) 

(make  Rule  “val  45) 


******** ********  **************** ****** ***************** 

If  the  no  manuever/narrow  view  filter  has  been  the 
best  for  a  while  and  suddenly  the  medium  manuever/narrow 
view  and  X-direction  filters  have  large  POC  levels,  then 
go  to  the  wide  view  filter. 


THEN  Goto  2 


;  IF  Best51!  for  last  4  and  P3  >  0.2 
;  and  P4  >  0.4 

(p  Rule50 

(Last4  “val  1) 

(P3  ‘val  >0.2) 

(P4  'val  >  0.4) 

-(KREST-Best) 

— > 

(make  KREST-Best  “val  2) 

(make  Rule  *val  50) 


******************************************************* 
If  the  best  filter  has  a  wide  view,  but  the  medium 
manuever/narrow  view  filter  has  sufficient  POC  level 
associated  with  it,  then  go  to  the  medium  manuever/ 
narrow  view  filter. 


ESS 


ESS 
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IF  Best=2  and  P3  >  0.25 


THEN  Goto  3 


(p  Rule55 

(Best  “val  2  ) 

(P3  “val  >  0.25) 

-(KREST-Best) 

--> 

(make  KREST-Best  “val  3) 
(make  Rule  *val  55) 


;******************************************************* 

;  If  the  best  filter  has  been  the  narrow  view  filter 
;  for  a  while  and  it  still  has  a  sufficient  POC  level 
;  assoicated  with  it,  even  if  the  new  best  filter  is 
;  extended  in  the  X-  or  Y-direction,  stick  with  the 
;  narrow  view  filter. 

;  IF  Best=l  for  last  3  or  more  and  PI  >  0.3 
;  and  the  new  Best=4  or  5  THEN  Goto  1 

(p  Rule65 

(Last3  *val  1) 

(PI  “val  >  0.3  ) 

(Best  “val  <<45  >>) 

-(KREST-Best) 

— > 

(make  KREST-Best  “val  1) 

(make  Rule  “val  65) 


***************************************************** 
If  the  system  is  confused  about  whether  the  X-  or 
Y-direction  filter  is  better,  (and  there  isn't  much 
POC  associated  with  the  medium  maneuver/narrow  view 
filter),  and  the  narrow  filter  is  better  than  the 
wide  view  filter,  and  the  narrow  filter  has  a  POC 
level  that's  large  enough,  then  go  with  the  narrow 
filter. 

IF  Best=4  or  5  and  P4  <  0.6  and 


wl*; 


-v.v. 


173 


L«U1.Vl.fUVl 


P5  <  0.6  and  P3  <  0.2  and 
PI  >  0.1  and  PI  >  P2 


THEN  Goto  1 


(p  Rule70 
(Best 
(P4 
(P5 
(P3 
(PI 


‘val  <<45  >>) 
‘val  <  0.6) 

‘val  <  0.6) 

‘val  <  0.2) 

‘val  >0.1) 


(PI -Great er- Than-P2 
-(KREST-Best) 


“val  t) 


(make  KREST-Best  “val  1) 
(make  Rule  “val  70) 


******* ************************************************ 

If  the  system  is  confused  about  whether  the  X-  or 
Y-direction  filter  is  better,  (and  there  isn't  much  P0C 
associated  with  the  medium  maneuver/narrow  view  filter) , 
and  the  wide  view  filter  is  better  than  the  narrow  filter, 
and  the  wide  view  filter  has  a  P0C  level  that  is  large 
enough,  then  go  with  the  wide  view  filter. 


IF  Best=4  or  5  and  P4  <  0.6  and 
P5  <  0.6  and  P3  <  0.2  and 
P2  >  0.1  and  P2  >  PI 


THEN  Goto  2 


(p  Rule75 
(Best 
(P4 
(P5 
(P3 
(P2 


(Best  “val  <<45  >>) 

(P4  "val  <0.6) 

(P5  “val  <  0.6) 

(P3  “val  <0.2) 

(P2  ‘val  >0.1) 

(Pl-Greater-Than-P2  ‘val  nil) 
(KREST-Best) 


(make  KREST-Best  “val  2) 

(make  Rule  “val  75) 

I 

;******************************************************** 
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The  Pilot's  Associate  (PA)  Proaram  has  been  initiated  to 
help  mitigate  the  extensive  workload  of  the  fighter  pilot. 

To  operate  effectively,  the  PA  system  must  have  situation 
awareness:  the  status  of  important  on-board  and  off-board 
systems.  This  knowledge  is  gained  through  sensor  systems. 

The  data  frcm  these  systems  must  be  "fused"  together  to 
present  the  PA  with  a  coherent  picture  of  the  internal 
(on-board)  and  external  (off-board)  states.  Although  many 
types  of  information  can  be  extracted  fran  sensor  data,  this 
paper  emphasizes  those  parameters  that  help  determine  target 
track.  One  common  technique  for  fusing  sensor  data  uses 
Kalman  filters.  In  a  multiple  model  adaptive  filter  (MMAF) 
system,  the  mcst  appropriate  Kalman  filter  is  chosen.  This 
filter  provides  the  "best"  estimates  of  the  desired  states. 

An  operating  MMAF  system  continually  selects  which  filter 
to  use  as  the  basis  for  the  state  estimates.  The  overall 
accuracy  of  the  system  is  closely  related  to  how  well  the 
filters  are  selected.  Previous  filter  selection  techniques 
have  proved  useful,  but  limited.  To  overcane  some  of  these 
limitations,  an  expert  system,  KREST  ,  was  developed  so  that 
expert  rules  could  be  used  to  select  filters.  Although  nc 
quantitative  estimate  of  improvement  is  available,  the  MMAF 
expert  stated  th  st  KREST  exhibited  a  potentially  significant 
improvement  over  the  previously  used  filter  selection 
techniques . 
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